NikolayKosarevO9 opened a new issue, #40576: URL: https://github.com/apache/arrow/issues/40576
### Describe the enhancement requested I'm using `pyarrow.Dataset.to_table(batch_size)` and the maximum batch size seems to be hard-coded to 1048576. It'd be good to make it more flexible (in my case I'm interested in numbers like 100 million), however, if it's there for a reason, mentioning it in documentation would already be helpful ### Component(s) Documentation, Python -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
