sfc-gh-mbojanczyk opened a new issue, #310:
URL: https://github.com/apache/arrow-go/issues/310

   ### Describe the enhancement requested
   
   [Variant 
encoding](https://github.com/apache/parquet-format/blob/master/VariantEncoding.md)
 looks like it's becoming part of the Parquet spec, and it'd be good to have 
Variant support in the Go library.
   
   It looks like implementation of Variants is already under way in the [Java 
Parquet library](https://github.com/apache/parquet-java/pull/3117), as well as 
in [Iceberg](https://github.com/apache/iceberg/pull/11857), so the spec seems 
to be settled enough that there shouldn't be massive changes in the base 
encoding. Looks like 
[shredding](https://github.com/apache/parquet-format/blob/master/VariantShredding.md)
 still hasn't been tackled yet by any library, so that may be more in flux.
   
   Variants will be a pretty powerful addon here for landing stuff in Iceberg- 
they generally have a good performance upside vs. using JSON or something 
similar. 
   
   ### Component(s)
   
   Parquet


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to