tibercus commented on issue #9773: URL: https://github.com/apache/iceberg/issues/9773#issuecomment-1968339465
@pvary Hi! > What do you mean by > > > FlinkSink in append-mode I mean appending data with DataStream: https://iceberg.apache.org/docs/latest/flink-writes/#appending-data > Could you please confirm that you have all of the expected types of files in your table: > > * data files for new rows (value 1, value 2, value 3) > * equality delete files for the deleted records (value 1, value 2) > * positional delete files for the records inserted and deleted in the same checkpoint (value 2) * Yes, there are data files for these three rows * No, there are no equality delete files * Yes, there is position delete for value 2 What you are asking about is upseting data (https://iceberg.apache.org/docs/latest/flink-writes/#upsert-data), but there is no upsert-enabled configuration set to true in both FlinkSink and Iceberg metadata. I created a repo to demonstrate the case. Please, take a look. You can find both source code and Iceberg files there. I made it a bit simpler (I only reproduce the checkpoint with two records being appended). https://github.com/tibercus/flink-iceberg-append-question Please note the example with Flink SQL in the repo. `INSERT INTO ... VALUES (1, 'value 1'), (1, 'value 2')` shows the same strange behavior. Thanks, Victor. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
