thomasaNvidia commented on issue #6783: URL: https://github.com/apache/iceberg/issues/6783#issuecomment-1424578537
@amogh-jahagirdar I have another job that works just fine and I took a look at the `inputFormat`, `outputFormat`, `serialization.lib` for the iceberg table that is working and they aren't set either. That job is saving to a different database and table but it's also reading from a non iceberg table within the catalog using `glueContext.create_dynamic_frame.from_catalog()`. It then writes using the same SQL statements as above but to a different location and it works fine. I do notice that within the table properties of the table that is working it has `metadata_location`, `previous_metadata_location`, and `table_type` where as the job that fails only has `metadata_location`, `table_type`. I wonder if using `glueContext.create_dynamic_frame.from_options()` since I am trying to read in S3 files is causing the issue somehow.. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
