rshdhere opened a new pull request, #18491: URL: https://github.com/apache/iceberg/pull/18491
Core: Add reference_snapshot_id to all_entries metadata table `all_entries` de-duplicated manifests shared across snapshots, so there was no way to tell which snapshots an entry was reachable from. Each entry is now listed once per snapshot that references its manifest, with the snapshot in a new `reference_snapshot_id` column, matching `all_manifests`. Manifests are still read only once. Closes #8856 Test plan: - Schema: `reference_snapshot_id` appears before `readable_metrics`. - A manifest shared by two snapshots produces one row per snapshot, with the correct IDs. - Leaving out the column doesn't change the row values. - Task JSON round-trips with and without reference snapshot IDs. - The Spark `all_entries` tests check the (snapshot_id, reference_snapshot_id) pairs. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
