ryanhaarmann opened a new issue, #47361: URL: https://github.com/apache/arrow/issues/47361
I converted from using `pyarrow.dataset.write_dataset` to `pyarrow.parquet.write_to_dataset` and noticed that this section of code is overwriting my max_row_group_size param to None. It seems it forces the user to pass in chunksize or row_group_size. I think an additional kwargs.pop would be necessary here. https://github.com/apache/arrow/blob/71a7b5531fd6ef96ce52d04491656031eb023c09/python/pyarrow/parquet/core.py#L2194-L2196 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
