hnwyllmm opened a new issue, #736: URL: https://github.com/apache/arrow-java/issues/736
### Describe the enhancement requested `ArrowVectorIterator::consume` only concern about the `ArrowVectorIterator#targetBatchSize` but not the memory used. Let's suppose a scenario: 1. A database table with a longtext field; 2. All of the rows in the table are larger than 500M; 3. `ArrowVectorIterator#targetBatchSize` is 256; We need at least for 125G memory to get one record batch. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@arrow.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
