kevinjqliu commented on issue #887: URL: https://github.com/apache/iceberg-python/issues/887#issuecomment-2204487503
So the current version of pyiceberg can write parquet files with the `large_string` data type. But the older version of pyiceberg cannot read the parquet file with the `large_string` data type. I feel like this is a library versioning problem and its ok to not be backwards compatible, esp before the 1.0 version. My opinion is that we should be able to support both `string` and `large_string` data types. And if supporting `large_string` type means the library won't be backwards compatible, that is ok. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
