thomasaNvidia opened a new issue, #6783:
URL: https://github.com/apache/iceberg/issues/6783
### Apache Iceberg version
1.0.0
### Query engine
Spark
### Please describe the bug 🐞
While using AWS Glue 4.0 and Iceberg 1.0.0 and leveraging the AWS Glue Data
Catalog, the field `inputFormat`, `outputFormat` and `serialization.lib` are
not being set when using spark.sql w/ Iceberg to create a new table.
```
CREATE TABLE IF NOT EXISTS
{catalog_name}.{output_database_name}.{output_table_name}
USING iceberg
OPTIONS (
'inputFormat' 'org.apache.hadoop.mapred.TextInputFormat',
'outputFormat'
'org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat',
'serialization.lib'
'org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe'
)
TBLPROPERTIES (
'table_type' = 'ICEBERG',
'format' = 'parquet',
'write_target_data_file_size_bytes' = '536870912'
)
AS SELECT * FROM incremental_input_data
```
The following doesn't work and you have to manually go into AWS Glue Data
Catalog and update `inputFormat`, `outputFormat` and `serialization.lib` if you
want to be able to insert data into that newly created table.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org
