jtfang opened a new issue, #11720: URL: https://github.com/apache/iceberg/issues/11720
Hi team I am working on an EMR (6.15) environment using Flink (1.17.1) Streaming API to write data into an Iceberg (1.4.0) table, but I have encountered some issues. It would be appreciated if you can give me some advice. The following is my use case: - I have an Iceberg table ice_upsert_flink with upsert enable and a primary key on the id column. Whenever a new event arrives, if the record does not exist, it should be inserted. If the record already exists, it should be updated. When a delete event is received, the record with the specified id should be deleted. - However, the incoming event data does not always include all the columns. [Q] : - As I know, upsert with pkey can perform insert if not exist or update the whole record. But may I know how to update partial columns with Pkey because the events will not always have all the data. Besides, is there any way to perform delete with the PKey? - If partial updates and deletes are not possible, what would you recommend doing in a similar scenario using Flink and Iceberg? I would greatly appreciate it if anyone could give me some advice! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
