kevinjqliu opened a new issue, #10120:
URL: https://github.com/apache/iceberg/issues/10120

   ### Feature Request / Improvement
   
   Based on discussions from 
[iceberg-python/#584](https://github.com/apache/iceberg-python/issues/584), we 
found that the Java Iceberg library "sanitizes" and transforms column names 
with special characters before writing to parquet. 
   
   For example, an Iceberg table with `TEST:A1B2.RAW.ABC-GG-1-A` column is 
transformed into `TEST_x3AA1B2_x2ERAW_x2EABC_x2DGG_x2D1_x2DA` which is then 
used to write the parquet files. 
   This process is done for both reads and writes. The behavior was introduced 
in #601
   
   I think Iceberg should (optionally) allow writing column names without the 
"sanitization" and transformation. This can be made configurable to enable 
backward compatibility.
   
   
   ### Query engine
   
   None


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org

Reply via email to