pvary commented on PR #14092: URL: https://github.com/apache/iceberg/pull/14092#issuecomment-3306787305
> I think we can achieve the same backwards compatibility guarantees without writing temporary manifest files. And instead, write data and delete files directly into a checkpoint as Avro data. Let me experiment with this and try to get a version with Avro serialisation working, which would give us backwards compatibility. There is an additional thing we should consider. What happens when the attributes of the Data/Delete files are changing. With the current way - storing the manifest -, we are automatically picking up changes done in the core. If we implement our own serializer/deserializer for them, we need to keep an eye out for these changes, and implement the corresponding changes in our serializers every time. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
