sungwy opened a new issue, #998:
URL: https://github.com/apache/iceberg-python/issues/998

   ### Feature Request / Improvement
   
   Currently `add_files` doesn't have a check to prevent adding an object 
that's already referenced by the Iceberg Table.
   
   We should include these two checks to prevent bad behaviors of adding an 
already referenced data file as a new manifest entry. 
   
   We could do this by running the following two checks before the file 
addition:
   1. First check that the list of `file_paths` is unique
   2. Check that all the files in the `file_paths` aren't referenced by any of 
the manifests in the current snapshot of the Iceberg Table.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org

Reply via email to