pvary commented on PR #18330:
URL: https://github.com/apache/iceberg/pull/18330#issuecomment-6012573094
> > What should a user do if they face this new error?
> **Overwrite / reload** — keep `.overwrite(true)`, do not set `upsertMode`
/ equality fields (data files only).
With Dynamic Sink the usertMode/equality fields are coming from the data
which is already in the checkpoint. So if the user don't change `overwrite`
then I don't see how it could recover from the error.
> **CDC / upsert** — keep upsert, set `.overwrite(false)` (or omit it;
default is false) so delete files go through the row-delta path.
Does this cause data duplication?
I think we should try to catch this issue sooner, and prevent storing data
with wrong configuration in the state.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
