Anurag-S1ngh opened a new pull request, #4392:
URL: https://github.com/apache/iceberg-python/pull/4392

   ## Summary
   
   A commit retry replays the append planned before the concurrent commit. The 
fast append producer skips concurrency validation, so a key another writer 
inserted after the upsert read was inserted a second time.
   
   ## Changes
   
   - Register the filter for the rows an upsert inserts on the append producer.
   - On retry, validate the data files added since the starting snapshot 
against that filter and raise `CommitFailedException` instead of inserting a 
duplicate key.
   - Plain appends keep skipping validation.
   
   ## Testing
   
   - Added a test with two table handles where one upserts a key after the 
other has read the table, asserting the second upsert fails and the key is 
stored once.
   - `make test` passes (4697 passed, 5 skipped).
   
   Closes #4194


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to