Guosmilesmile opened a new pull request, #14761:
URL: https://github.com/apache/iceberg/pull/14761
When I add UT for unknown type in Flinkļ¼use ORC will meet exception.
```
java.lang.IllegalArgumentException: Invalid iceberg type unknown
corresponding to Flink logical type NULL
at
org.apache.iceberg.flink.data.FlinkOrcWriter$WriteBuilder.primitive(FlinkOrcWriter.java:157)
at
org.apache.iceberg.flink.data.FlinkOrcWriter$WriteBuilder.primitive(FlinkOrcWriter.java:67)
at
org.apache.iceberg.flink.data.FlinkSchemaVisitor.visit(FlinkSchemaVisitor.java:83)
at
org.apache.iceberg.flink.data.FlinkSchemaVisitor.visitRecord(FlinkSchemaVisitor.java:110)
at
org.apache.iceberg.flink.data.FlinkSchemaVisitor.visit(FlinkSchemaVisitor.java:41)
at
org.apache.iceberg.flink.data.FlinkSchemaVisitor.visit(FlinkSchemaVisitor.java:35)
at
org.apache.iceberg.flink.data.FlinkOrcWriter.<init>(FlinkOrcWriter.java:44)
at
org.apache.iceberg.flink.data.FlinkOrcWriter.buildWriter(FlinkOrcWriter.java:48)
```
In ORC write, I think we should ignore unkonwn type in file schema. This pr
is to fix it.
This pr also add ut for other FileFomate(Parquet, ORC,AVRO ) in Flink read
and write.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
