owen6314 commented on issue #14160: URL: https://github.com/apache/iceberg/issues/14160#issuecomment-3373298273
Some detail: Support Dynamic Snapshot Property Injection in FlinkSink Currently, the Flink-Iceberg sink only supports specifying static snapshot properties at build time via the builder API. There is no built-in way to set or customize snapshot properties dynamically for each commit or checkpoint. Extend the Flink-Iceberg sink to allow users to provide a function or callback that generates snapshot properties dynamically per commit or checkpoint. This would enable users to inject custom metadata, such as row counts, min/max timestamps, watermarks, or task-specific annotations into Iceberg snapshots at runtime. Similar to how [snapshot-property.custom-key](https://iceberg.apache.org/docs/latest/spark-configuration/?utm_source=openai#write-options) works in Spark. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
