amogh-jahagirdar commented on issue #9928: URL: https://github.com/apache/iceberg/issues/9928#issuecomment-1988839060
@nikita-sheremet-flocktory Iceberg snapshots have a summary which can be used to store all these details. https://iceberg.apache.org/spec/#snapshots . The summary already contains stats like added files, removed files, etc but you can store additional properties like Job/User details as well in that structure. Which compute engine are you using? Spark actions already have a `snapshotProperty` API you can use to set those details. Also you can set an option `snapshot-property.key` when performing the DF writes https://iceberg.apache.org/docs/latest/spark-configuration/#write-options. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
