[I] Cannot insert table created by spark temp into iceberg table [iceberg]

[via GitHub]

hellonewplayer opened a new issue, #10164:
URL: https://github.com/apache/iceberg/issues/10164

   ### Apache Iceberg version
   
   None
   
   ### Query engine
   
   Spark
   
   ### Please describe the bug 🐞
   
   Helo, I got a similar issue to https://github.com/apache/iceberg/issues/510.
   I have created a iceberg table.
   `
   table 
   {
     1: optionalField: optional string
     2: requiredField: required string
   }
    `
   I used pyspark to read a csv file.
   ‘
   
   spark_schema {
     optional binary optionalField (UTF8);
     required binary requiredField (UTF8);
   }
   ’
   After that, I used this df to create a Temp table.
   And use this as a data source merge into the target table(which I created 
iceberg table).
   
   ‘
   
   Cannot write incompatible dataset to table with schema.
   It shows the similar error.
   table {
     1: optionalField: optional string
     2: requiredField: required string
   }
   Problems:
   * requiredField should be required, but is optional
   ’
   Is this my iceberg version not the latest or I am using wrong method to 
insert the data? Thank you!
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org