davseitsev opened a new pull request, #12892: URL: https://github.com/apache/iceberg/pull/12892
It's revival and extension of #2850, regards to @sshkvar. This PR introduces a new catalog property, `unique-table-location`, which enables generating unique table locations for catalogs that support table rename operations. The feature is disabled by default to preserve current behavior. When enabled, a unique suffix is added to the table path, ensuring that each table has its own dedicated storage location including scenarios involving table renames. This addresses a key issue where, after renaming a table and creating a new one with the original name, both tables would otherwise share the same location. Such overlap can lead to: - **Data loss** during the `DeleteOrphanFilesSparkAction`, which may inadvertently delete files belonging to other tables in the shared location. - **Difficulties in analyzing table-specific storage costs**, as storage usage cannot be cleanly attributed to individual tables. - **Inability to apply path-based rules** such as S3 Intelligent-Tiering, Lifecycle Rules, or fine-grained permissions, which depend on isolated storage paths. NessieCatalog already supports it, but it's not configurable: https://github.com/apache/iceberg/blob/ee2ffb4e94f166f4ffb371a01050e4fb92474b22/nessie/src/main/java/org/apache/iceberg/nessie/NessieCatalog.java#L258 Such feature was added to Trino a while ago https://github.com/trinodb/trino/pull/6063 and related discussion https://github.com/trinodb/trino/issues/5632#issuecomment-714274998 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
