[GitHub] [iceberg] mriveraFacephi commented on issue #2040: Partial data ingestion to Iceberg in failing with Spark 3.0.x

[GitBox]

mriveraFacephi commented on issue #2040:
URL: https://github.com/apache/iceberg/issues/2040#issuecomment-1398240262

   Same problem here with Spark 3.1.1 and Iceberg 0.13.1. I'm trying to write 
dataframe by using the Spark v2 API command writeTo. 
   Every column in my schema is nullable. In my case, I'm using AWS Glue, and 
the table metadata looks like:
   `"Columns": [
         {
           "Name": "col",
           "Type": "string",
           "Parameters": {
             "iceberg.field.current": "true",
             "iceberg.field.id": "1",
             **"iceberg.field.optional": "true"**
           }
         },...`
   
   Thanks


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org