eric-maynard commented on PR #13709: URL: https://github.com/apache/iceberg/pull/13709#issuecomment-3145183103
Hi @danielcweeks, thanks for taking a look. My ambition is to support all the same encodings that Spark supports, so that users don't run into a situation where their Iceberg client can't read Parquet files written by Spark. This does include DELTA_LENGTH_BYTE_ARRAY. Besides the encoding being in the Parquet docs (and therefore the site) it's also supported by the Parquet code. While this encoding isn't used by default for any types, it does look to me like a supported encoding. At least, it seems ambiguous. When you say it's not officially supported, can you share more about that? What would it take for Parquet to officially mark it as supported (or unsupported) to there is no ambiguity here? Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
