dyzcs commented on issue #9955: URL: https://github.com/apache/iceberg/issues/9955#issuecomment-1996547964
@okayhooni I'm not sure if Iceberg has a similar development plan, but overall, Iceberg won't imitate Kafka's related features. I understand Iceberg's positioning as a table format. Returning to your question, the above two features can be developed based on the current version of Iceberg. Firstly, obtain the latest snapshot ID: https://iceberg.apache.org/docs/latest/flink-queries/#snapshots You can obtain all snapshot information. Secondly, https://iceberg.apache.org/docs/latest/flink-configuration/#read-options The following situations should meet the requirements: **TABLE_SCAN_THEN_INCREMENTAL**: Do a regular table scan then switch to the incremental mode. The incremental mode starts from the current snapshot exclusive. **INCREMENTAL_FROM_LATEST_SNAPSHOT**: Start incremental mode from the latest snapshot inclusive. If it is an empty map, all future append snapshots should be discovered. **INCREMENTAL_FROM_EARLIEST_SNAPSHOT**: Start incremental mode from the earliest snapshot inclusive. If it is an empty map, all future append snapshots should be discovered. **INCREMENTAL_FROM_SNAPSHOT_ID**: Start incremental mode from a snapshot with a specific id inclusive. **INCREMENTAL_FROM_SNAPSHOT_TIMESTAMP**: Start incremental mode from a snapshot with a specific timestamp inclusive. If the timestamp is between two snapshots, it should start from the snapshot after the timestamp. Just for FIP27 Source. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
