gwindes opened a new issue, #584: URL: https://github.com/apache/iceberg-python/issues/584
### Apache Iceberg version 0.6.0 (latest release) ### Please describe the bug 🐞 Related to: https://github.com/apache/iceberg-python/issues/81 Python `v3.12` ``` pyiceberg 0.6.0 pyarrow 15.0.2 pandas 2.2.1 ``` I believe this is a bug, but I may also be misunderstanding how pyiceberg and pyarrow are working with iceberg tables and thus I may be doing something wrong. However, when I sanitize the column name before writing the data to remove `: . - /` I'm able to query just fine. My understanding is that the following iceberg column name is a valid name `TEST:A1B2.RAW.ABC-GG-1-A`. With the caveat that it is NOT a nested field (which I don't need). I'm able to write the data to the iceberg table and it shows the metadata with the fully qualified name of `TEST:A1B2.RAW.ABC-GG-1-A` in the metadata json. It appears to be only fail when I want to read the data. I'm following the basic [getting started in the pyiceberg](https://py.iceberg.apache.org/#write-a-pyarrow-dataframe) ``` table = catalog.load_table("A1B2.A1-301") # neither table scan works (throws the same error): df_pyarrow = table.scan().to_arrow() df_panda = table.scan().to_pandas() ``` I created a [sample project](https://github.com/gwindes/pyiceberg-arrow-bug/blob/main/column_name_test.py) that reproduces my problem with the `pyarrow.lib.ArrowInvalid: No match for FieldRef.Name` error. Image showing metadata is storing channel name as expected. <img width="780" alt="image" src="https://github.com/apache/iceberg-python/assets/843453/9d0f656a-5bf3-45f8-a4c3-5c39fbc8afa0";> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
