swuferhong opened a new issue, #621:
URL: https://github.com/apache/arrow-java/issues/621

   ### Describe the enhancement requested
   
   Currently, to do compression for one `ArrowRecordBatch`,  in 
`VectorUnloader`, it will separately compress each `ArrowBuffer` within the 
`FieldVector` instead of compress at the `FieldVector level`.  From the 
compression rate perspective, larger batches generally result in higher 
compression rates. Additionally, calling `compress(BufferAllocator allocator, 
ArrowBuf uncompressedBuffer)` multiple times may consume more CPU than call 
once. 
   
   Therefore, I would like to ask if there will be support for overall 
compression at the `FieldVector level`, which could improve the compression 
ratio without affecting the ability to read individual columns.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to