ebyhr commented on code in PR #13996: URL: https://github.com/apache/iceberg/pull/13996#discussion_r2324414005
########## site/docs/releases.md: ########## @@ -67,16 +67,145 @@ To add a dependency on Iceberg in Maven, add the following to your `pom.xml`: </dependencies> ``` +### 1.10.0 release + +Apache Iceberg 1.10.0 was released on September ??, 2025. + +The 1.10.0 release contains bug fixes and new features. For full release notes visit [Github](https://github.com/apache/iceberg/releases/tag/apache-iceberg-1.10.0) + +* Deprecation / End of Support + - Flink: Remove Flink 1.18 support ([\#13191](https://github.com/apache/iceberg/pull/13191)) + - Common: Remove public visibility for deprecated methods in DynConstructors and DynMethods since 1.7.0 ([\#13053](https://github.com/apache/iceberg/pull/13053)) + - AWS, Core, Flink, Parquet: Remove deprecations targeted for 1.10.0 ([\#12909](https://github.com/apache/iceberg/pull/12909)) +* Behavior change + - Hive: Throw NoSuchNamespaceException when listing a non-exist namespace ([\#13130](https://github.com/apache/iceberg/pull/13130)). + Previously, an empty list was returned. + - Core: fix spec non-confirming field ids for partition stats files ([\#13329](https://github.com/apache/iceberg/pull/13329)) +* Spec + - Table: Clarify write requirement to prevent orphaned DVs ([\#13042](https://github.com/apache/iceberg/pull/13042)) + - Table: Clarify behavior of special geo objects for lower and upper bounds ([\#12956](https://github.com/apache/iceberg/pull/12956)) + - Table: Add encryption keys ([\#12162](https://github.com/apache/iceberg/pull/12162)) + - Table: Avoid struct field conflicts in default values ([\#12841](https://github.com/apache/iceberg/pull/12841)) + - REST: Add row lineage fields ([\#13010](https://github.com/apache/iceberg/pull/13010)) + - REST: Add encryption keys ([\#12987](https://github.com/apache/iceberg/pull/12987)) + - REST: remove update to enable row lineage as it is always on for V3 table Support multiple storage credential prefixes ([\#12986](https://github.com/apache/iceberg/pull/12986)) + - REST: mark 503 as non retryable ([\#13619](https://github.com/apache/iceberg/pull/13619)) +* API + - Add table metadata keys for encryption ([\#12927](https://github.com/apache/iceberg/pull/12927)) + - Add deleteFile to RowDelta API ([\#12861](https://github.com/apache/iceberg/pull/12861)) + - Expose cleanExpiredMetadata in ExpireSnapshots ([\#13509](https://github.com/apache/iceberg/pull/13509)) + - Preserve original type for upper/lower bounds in metrics ([\#13695](https://github.com/apache/iceberg/pull/13695)) + - Fix timestamp(9) with identity partitioning ([\#13746](https://github.com/apache/iceberg/pull/13746)) + - Add expression factory methods for timestamp literals ([\#13747](https://github.com/apache/iceberg/pull/13747)) +* Core + - Fix JDBC catalog race condition with creating table if not exist ([\#13345](https://github.com/apache/iceberg/pull/13345)) Review Comment: I thought this change was about a failure when the query engine executed `CREATE TABLE IF NOT EXISTS`, but the actual issue is a JDBC catalog initialization failure. What about "Fix a race condition in the JDBC catalog during catalog table initialization" or something? ########## site/docs/releases.md: ########## @@ -67,16 +67,145 @@ To add a dependency on Iceberg in Maven, add the following to your `pom.xml`: </dependencies> ``` +### 1.10.0 release + +Apache Iceberg 1.10.0 was released on September ??, 2025. + +The 1.10.0 release contains bug fixes and new features. For full release notes visit [Github](https://github.com/apache/iceberg/releases/tag/apache-iceberg-1.10.0) + +* Deprecation / End of Support + - Flink: Remove Flink 1.18 support ([\#13191](https://github.com/apache/iceberg/pull/13191)) + - Common: Remove public visibility for deprecated methods in DynConstructors and DynMethods since 1.7.0 ([\#13053](https://github.com/apache/iceberg/pull/13053)) + - AWS, Core, Flink, Parquet: Remove deprecations targeted for 1.10.0 ([\#12909](https://github.com/apache/iceberg/pull/12909)) +* Behavior change + - Hive: Throw NoSuchNamespaceException when listing a non-exist namespace ([\#13130](https://github.com/apache/iceberg/pull/13130)). + Previously, an empty list was returned. + - Core: fix spec non-confirming field ids for partition stats files ([\#13329](https://github.com/apache/iceberg/pull/13329)) +* Spec + - Table: Clarify write requirement to prevent orphaned DVs ([\#13042](https://github.com/apache/iceberg/pull/13042)) + - Table: Clarify behavior of special geo objects for lower and upper bounds ([\#12956](https://github.com/apache/iceberg/pull/12956)) + - Table: Add encryption keys ([\#12162](https://github.com/apache/iceberg/pull/12162)) + - Table: Avoid struct field conflicts in default values ([\#12841](https://github.com/apache/iceberg/pull/12841)) + - REST: Add row lineage fields ([\#13010](https://github.com/apache/iceberg/pull/13010)) + - REST: Add encryption keys ([\#12987](https://github.com/apache/iceberg/pull/12987)) + - REST: remove update to enable row lineage as it is always on for V3 table Support multiple storage credential prefixes ([\#12986](https://github.com/apache/iceberg/pull/12986)) + - REST: mark 503 as non retryable ([\#13619](https://github.com/apache/iceberg/pull/13619)) +* API + - Add table metadata keys for encryption ([\#12927](https://github.com/apache/iceberg/pull/12927)) + - Add deleteFile to RowDelta API ([\#12861](https://github.com/apache/iceberg/pull/12861)) + - Expose cleanExpiredMetadata in ExpireSnapshots ([\#13509](https://github.com/apache/iceberg/pull/13509)) + - Preserve original type for upper/lower bounds in metrics ([\#13695](https://github.com/apache/iceberg/pull/13695)) + - Fix timestamp(9) with identity partitioning ([\#13746](https://github.com/apache/iceberg/pull/13746)) + - Add expression factory methods for timestamp literals ([\#13747](https://github.com/apache/iceberg/pull/13747)) +* Core + - Fix JDBC catalog race condition with creating table if not exist ([\#13345](https://github.com/apache/iceberg/pull/13345)) + - Properly close resources when catalog initialization fails ([\#13384](https://github.com/apache/iceberg/pull/13384)) Review Comment: ```suggestion - Properly close resources when REST catalog initialization fails ([\#13384](https://github.com/apache/iceberg/pull/13384)) ``` ########## site/docs/releases.md: ########## @@ -67,16 +67,145 @@ To add a dependency on Iceberg in Maven, add the following to your `pom.xml`: </dependencies> ``` +### 1.10.0 release + +Apache Iceberg 1.10.0 was released on September ??, 2025. + +The 1.10.0 release contains bug fixes and new features. For full release notes visit [Github](https://github.com/apache/iceberg/releases/tag/apache-iceberg-1.10.0) + +* Deprecation / End of Support + - Flink: Remove Flink 1.18 support ([\#13191](https://github.com/apache/iceberg/pull/13191)) + - Common: Remove public visibility for deprecated methods in DynConstructors and DynMethods since 1.7.0 ([\#13053](https://github.com/apache/iceberg/pull/13053)) + - AWS, Core, Flink, Parquet: Remove deprecations targeted for 1.10.0 ([\#12909](https://github.com/apache/iceberg/pull/12909)) +* Behavior change + - Hive: Throw NoSuchNamespaceException when listing a non-exist namespace ([\#13130](https://github.com/apache/iceberg/pull/13130)). + Previously, an empty list was returned. + - Core: fix spec non-confirming field ids for partition stats files ([\#13329](https://github.com/apache/iceberg/pull/13329)) +* Spec + - Table: Clarify write requirement to prevent orphaned DVs ([\#13042](https://github.com/apache/iceberg/pull/13042)) + - Table: Clarify behavior of special geo objects for lower and upper bounds ([\#12956](https://github.com/apache/iceberg/pull/12956)) + - Table: Add encryption keys ([\#12162](https://github.com/apache/iceberg/pull/12162)) + - Table: Avoid struct field conflicts in default values ([\#12841](https://github.com/apache/iceberg/pull/12841)) + - REST: Add row lineage fields ([\#13010](https://github.com/apache/iceberg/pull/13010)) + - REST: Add encryption keys ([\#12987](https://github.com/apache/iceberg/pull/12987)) + - REST: remove update to enable row lineage as it is always on for V3 table Support multiple storage credential prefixes ([\#12986](https://github.com/apache/iceberg/pull/12986)) + - REST: mark 503 as non retryable ([\#13619](https://github.com/apache/iceberg/pull/13619)) +* API + - Add table metadata keys for encryption ([\#12927](https://github.com/apache/iceberg/pull/12927)) + - Add deleteFile to RowDelta API ([\#12861](https://github.com/apache/iceberg/pull/12861)) + - Expose cleanExpiredMetadata in ExpireSnapshots ([\#13509](https://github.com/apache/iceberg/pull/13509)) + - Preserve original type for upper/lower bounds in metrics ([\#13695](https://github.com/apache/iceberg/pull/13695)) + - Fix timestamp(9) with identity partitioning ([\#13746](https://github.com/apache/iceberg/pull/13746)) + - Add expression factory methods for timestamp literals ([\#13747](https://github.com/apache/iceberg/pull/13747)) +* Core + - Fix JDBC catalog race condition with creating table if not exist ([\#13345](https://github.com/apache/iceberg/pull/13345)) + - Properly close resources when catalog initialization fails ([\#13384](https://github.com/apache/iceberg/pull/13384)) + - Fix spec non-confirming field ids for partition stats files ([\#13329](https://github.com/apache/iceberg/pull/13329)) + - Partitions metadata returns incomplete list in case of partition evolution and null partition value ([\#12528](https://github.com/apache/iceberg/pull/12528)) + - Support incremental refresh for partition stats ([\#12629](https://github.com/apache/iceberg/pull/12629)) + - Add max number of files rewrite option ([\#12824](https://github.com/apache/iceberg/pull/12824)) + - Add table property of column prefix to enable column statistics ([\#12770](https://github.com/apache/iceberg/pull/12770)) Review Comment: ```suggestion - Add table property of column prefix to enable Parquet column statistics ([\#12770](https://github.com/apache/iceberg/pull/12770)) ``` ########## site/docs/releases.md: ########## @@ -67,16 +67,145 @@ To add a dependency on Iceberg in Maven, add the following to your `pom.xml`: </dependencies> ``` +### 1.10.0 release + +Apache Iceberg 1.10.0 was released on September ??, 2025. + +The 1.10.0 release contains bug fixes and new features. For full release notes visit [Github](https://github.com/apache/iceberg/releases/tag/apache-iceberg-1.10.0) + +* Deprecation / End of Support + - Flink: Remove Flink 1.18 support ([\#13191](https://github.com/apache/iceberg/pull/13191)) + - Common: Remove public visibility for deprecated methods in DynConstructors and DynMethods since 1.7.0 ([\#13053](https://github.com/apache/iceberg/pull/13053)) + - AWS, Core, Flink, Parquet: Remove deprecations targeted for 1.10.0 ([\#12909](https://github.com/apache/iceberg/pull/12909)) +* Behavior change + - Hive: Throw NoSuchNamespaceException when listing a non-exist namespace ([\#13130](https://github.com/apache/iceberg/pull/13130)). + Previously, an empty list was returned. + - Core: fix spec non-confirming field ids for partition stats files ([\#13329](https://github.com/apache/iceberg/pull/13329)) +* Spec + - Table: Clarify write requirement to prevent orphaned DVs ([\#13042](https://github.com/apache/iceberg/pull/13042)) + - Table: Clarify behavior of special geo objects for lower and upper bounds ([\#12956](https://github.com/apache/iceberg/pull/12956)) + - Table: Add encryption keys ([\#12162](https://github.com/apache/iceberg/pull/12162)) + - Table: Avoid struct field conflicts in default values ([\#12841](https://github.com/apache/iceberg/pull/12841)) + - REST: Add row lineage fields ([\#13010](https://github.com/apache/iceberg/pull/13010)) + - REST: Add encryption keys ([\#12987](https://github.com/apache/iceberg/pull/12987)) + - REST: remove update to enable row lineage as it is always on for V3 table Support multiple storage credential prefixes ([\#12986](https://github.com/apache/iceberg/pull/12986)) + - REST: mark 503 as non retryable ([\#13619](https://github.com/apache/iceberg/pull/13619)) +* API + - Add table metadata keys for encryption ([\#12927](https://github.com/apache/iceberg/pull/12927)) + - Add deleteFile to RowDelta API ([\#12861](https://github.com/apache/iceberg/pull/12861)) + - Expose cleanExpiredMetadata in ExpireSnapshots ([\#13509](https://github.com/apache/iceberg/pull/13509)) + - Preserve original type for upper/lower bounds in metrics ([\#13695](https://github.com/apache/iceberg/pull/13695)) + - Fix timestamp(9) with identity partitioning ([\#13746](https://github.com/apache/iceberg/pull/13746)) + - Add expression factory methods for timestamp literals ([\#13747](https://github.com/apache/iceberg/pull/13747)) +* Core + - Fix JDBC catalog race condition with creating table if not exist ([\#13345](https://github.com/apache/iceberg/pull/13345)) + - Properly close resources when catalog initialization fails ([\#13384](https://github.com/apache/iceberg/pull/13384)) + - Fix spec non-confirming field ids for partition stats files ([\#13329](https://github.com/apache/iceberg/pull/13329)) + - Partitions metadata returns incomplete list in case of partition evolution and null partition value ([\#12528](https://github.com/apache/iceberg/pull/12528)) + - Support incremental refresh for partition stats ([\#12629](https://github.com/apache/iceberg/pull/12629)) + - Add max number of files rewrite option ([\#12824](https://github.com/apache/iceberg/pull/12824)) + - Add table property of column prefix to enable column statistics ([\#12770](https://github.com/apache/iceberg/pull/12770)) + - Ignore partition fields that are dropped from current schema ([\#11868](https://github.com/apache/iceberg/pull/11868)) + - Propagate and delete dangling DVs when rewriting data files ([\#13245](https://github.com/apache/iceberg/pull/13245/)) + - Support DV in partition stats ([\#13425](https://github.com/apache/iceberg/pull/13425)) + - Track data files to be removed for orphaned DV cleanup ([\#13222](https://github.com/apache/iceberg/pull/13222)) + - Use bulk deletion for cleaning up uncommitted files in BaseTransaction ([\#13653](https://github.com/apache/iceberg/pull/13653)) + - Use zero copy wrapper for equalityFieldIds in BaseFile ([\#13212](https://github.com/apache/iceberg/pull/13212)) + - Prevent empty Puffin file creation in DV writer ([\#13666](https://github.com/apache/iceberg/pull/13666)) + - Fix incorrect selection of incremental cleanup in ExpireSnapshots ([\#13614](https://github.com/apache/iceberg/pull/13614)) + - Fix metrics column limit with nested column ([\#13039](https://github.com/apache/iceberg/pull/13039)) + - Support timestamp(9) in single value parser ([\#13487](https://github.com/apache/iceberg/pull/13487)) + - Refactor DeleteOrphanFiles to support code sharing between Flink and Spark ([\#13429](https://github.com/apache/iceberg/pull/13429)) Review Comment: The PR didn't modify `DeleteOrphanFiles` classs. It was `DeleteOrphanFilesSparkAction`. We could change to "Add FileURI and FileSystemWalker utility classes" or something. That is the actual impact to developers in my understanding. ########## site/docs/releases.md: ########## @@ -67,16 +67,145 @@ To add a dependency on Iceberg in Maven, add the following to your `pom.xml`: </dependencies> ``` +### 1.10.0 release + +Apache Iceberg 1.10.0 was released on September ??, 2025. + +The 1.10.0 release contains bug fixes and new features. For full release notes visit [Github](https://github.com/apache/iceberg/releases/tag/apache-iceberg-1.10.0) + +* Deprecation / End of Support + - Flink: Remove Flink 1.18 support ([\#13191](https://github.com/apache/iceberg/pull/13191)) + - Common: Remove public visibility for deprecated methods in DynConstructors and DynMethods since 1.7.0 ([\#13053](https://github.com/apache/iceberg/pull/13053)) + - AWS, Core, Flink, Parquet: Remove deprecations targeted for 1.10.0 ([\#12909](https://github.com/apache/iceberg/pull/12909)) +* Behavior change + - Hive: Throw NoSuchNamespaceException when listing a non-exist namespace ([\#13130](https://github.com/apache/iceberg/pull/13130)). + Previously, an empty list was returned. + - Core: fix spec non-confirming field ids for partition stats files ([\#13329](https://github.com/apache/iceberg/pull/13329)) +* Spec + - Table: Clarify write requirement to prevent orphaned DVs ([\#13042](https://github.com/apache/iceberg/pull/13042)) + - Table: Clarify behavior of special geo objects for lower and upper bounds ([\#12956](https://github.com/apache/iceberg/pull/12956)) + - Table: Add encryption keys ([\#12162](https://github.com/apache/iceberg/pull/12162)) + - Table: Avoid struct field conflicts in default values ([\#12841](https://github.com/apache/iceberg/pull/12841)) + - REST: Add row lineage fields ([\#13010](https://github.com/apache/iceberg/pull/13010)) + - REST: Add encryption keys ([\#12987](https://github.com/apache/iceberg/pull/12987)) + - REST: remove update to enable row lineage as it is always on for V3 table Support multiple storage credential prefixes ([\#12986](https://github.com/apache/iceberg/pull/12986)) + - REST: mark 503 as non retryable ([\#13619](https://github.com/apache/iceberg/pull/13619)) +* API + - Add table metadata keys for encryption ([\#12927](https://github.com/apache/iceberg/pull/12927)) + - Add deleteFile to RowDelta API ([\#12861](https://github.com/apache/iceberg/pull/12861)) + - Expose cleanExpiredMetadata in ExpireSnapshots ([\#13509](https://github.com/apache/iceberg/pull/13509)) + - Preserve original type for upper/lower bounds in metrics ([\#13695](https://github.com/apache/iceberg/pull/13695)) + - Fix timestamp(9) with identity partitioning ([\#13746](https://github.com/apache/iceberg/pull/13746)) + - Add expression factory methods for timestamp literals ([\#13747](https://github.com/apache/iceberg/pull/13747)) +* Core + - Fix JDBC catalog race condition with creating table if not exist ([\#13345](https://github.com/apache/iceberg/pull/13345)) + - Properly close resources when catalog initialization fails ([\#13384](https://github.com/apache/iceberg/pull/13384)) + - Fix spec non-confirming field ids for partition stats files ([\#13329](https://github.com/apache/iceberg/pull/13329)) + - Partitions metadata returns incomplete list in case of partition evolution and null partition value ([\#12528](https://github.com/apache/iceberg/pull/12528)) + - Support incremental refresh for partition stats ([\#12629](https://github.com/apache/iceberg/pull/12629)) + - Add max number of files rewrite option ([\#12824](https://github.com/apache/iceberg/pull/12824)) + - Add table property of column prefix to enable column statistics ([\#12770](https://github.com/apache/iceberg/pull/12770)) + - Ignore partition fields that are dropped from current schema ([\#11868](https://github.com/apache/iceberg/pull/11868)) + - Propagate and delete dangling DVs when rewriting data files ([\#13245](https://github.com/apache/iceberg/pull/13245/)) + - Support DV in partition stats ([\#13425](https://github.com/apache/iceberg/pull/13425)) + - Track data files to be removed for orphaned DV cleanup ([\#13222](https://github.com/apache/iceberg/pull/13222)) + - Use bulk deletion for cleaning up uncommitted files in BaseTransaction ([\#13653](https://github.com/apache/iceberg/pull/13653)) + - Use zero copy wrapper for equalityFieldIds in BaseFile ([\#13212](https://github.com/apache/iceberg/pull/13212)) + - Prevent empty Puffin file creation in DV writer ([\#13666](https://github.com/apache/iceberg/pull/13666)) + - Fix incorrect selection of incremental cleanup in ExpireSnapshots ([\#13614](https://github.com/apache/iceberg/pull/13614)) + - Fix metrics column limit with nested column ([\#13039](https://github.com/apache/iceberg/pull/13039)) + - Support timestamp(9) in single value parser ([\#13487](https://github.com/apache/iceberg/pull/13487)) + - Refactor DeleteOrphanFiles to support code sharing between Flink and Spark ([\#13429](https://github.com/apache/iceberg/pull/13429)) + - Batch load new files when validating replaced partitions ([\#13556](https://github.com/apache/iceberg/pull/13556)) Review Comment: The sentence looks too general. The PR only affected cherry-picks and fast-forwards operations in my understanding. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
