raunaqmorarka opened a new pull request, #17708:
URL: https://github.com/apache/iceberg/pull/17708
BaseTransaction resolves its newly committed snapshots through
`ops.current()`, a catalog re-read that can return stale metadata when the
catalog caches table pointers. When any new snapshot is missing from the stale
view, `committedFiles` returns null and clean-up of all uncommitted files is
skipped ("Failed to load metadata for a committed snapshot, skipping
clean-up"). With concurrent writers on a Glue catalog this fired on every
commit and leaked one stale manifest list per commit retry attempt.
The transaction's own committed metadata always contains the new snapshots,
so resolve them there.
The new test serves stale metadata from `current()` after a successful
commit with injected retries. Without the fix it fails because no uncommitted
files are ever deleted.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
