zeodtr opened a new issue, #179: URL: https://github.com/apache/iceberg-rust/issues/179
Currently, the avro schema names in the source code are as follows: * ManifestList: "manifest_list" * Manifest: "manifest" (Search for `schema_to_avro_schema` function calls to see them) But official names in the spec(https://iceberg.apache.org/spec/) are as follows: * ManifestList: "manifest_file" * Manifest: "manifest_entry" This difference makes Iceberg Spark SQL (using `spark-3.2.2-bin-hadoop3.2.tgz` and `iceberg-spark-runtime-3.2_2.12-1.4.3.jar`) cannot read the manifest list files and manifest files that are created by iceberg-rust. For example, Iceberg Spark SQL's error message for ManifestFile is as follows: `org.apache.iceberg.shaded.org.apache.avro.generic.GenericData$Record cannot be cast to org.apache.iceberg.ManifestFile` When I changed the avro schema names to the official ones, those errors were gone. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
