jkolash commented on issue #13297: URL: https://github.com/apache/iceberg/issues/13297#issuecomment-2968557949
I wanted to bring up another point that @RussellSpitzer helped me identify which was this issue reproduces in a similar way with the v2 Datasources when I Ran https://github.com/apache/iceberg/issues/13297#issuecomment-2963910701 but set the spark option ```spark.sql.sources.useV1SourceList``` to an empty string it reproduced via the new v2 datasource code, but not the v1 datasource.  So this issue also needs to be addressed in spark as well. On the spark side I think the close() call likely should be done on task completion not via a callback on job completion?, and the metrics can be collected before that close? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
