fallintoplace opened a new issue, #1884:
URL: https://github.com/apache/iceberg-go/issues/1884

   ## Summary
   
   The incremental changelog scan in #1883 currently plans changes from 
data-manifest entries:
   
   - **INSERT** for added data files
   - **DELETE** for removed data files
   
   Snapshots with delete manifests are not supported yet.
   
   ## Follow-up
   
   Add changelog support for row changes produced by:
   
   - position delete files
   - equality delete files
   - deletion vectors
   
   The planner should distinguish deletes produced by the current snapshot from 
rows that were already deleted by earlier snapshots. The reader should return 
the rows removed by the current change.
   
   The task API will likely need separate added-delete and existing-delete 
information, similar to the Java changelog task types.
   
   ## Related
   
   - PR #1883: https://github.com/apache/iceberg-go/pull/1883
   - Java reference: 
https://github.com/apache/iceberg/blob/main/core/src/main/java/org/apache/iceberg/BaseIncrementalChangelogScan.java


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to