asfimport opened a new issue, #303:
URL: https://github.com/apache/arrow-java/issues/303
Several ScanOptions methods take a batchSize argument as shown:
`public ScanOptions(long batchSize) {`
` this(batchSize, Optional.empty());`
``}
Since the scanner reads one ArrowRecordBatch per load invocation, setting
the parameter to a size larger than the RecordBatch has no effect. It only
works when it's smaller than the number of rows in the RecordBatch, (i.e., the
number or records read is equal to min(batchSize, recordBatch rowCount),
potentially leading to some confusion.
**Reporter**: [Larry
White](https://issues.apache.org/jira/browse/ARROW-17346) / @lwhite1
<sub>**Note**: *This issue was originally created as
[ARROW-17346](https://issues.apache.org/jira/browse/ARROW-17346). Please see
the [migration documentation](https://github.com/apache/arrow/issues/14542) for
further details.*</sub>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
