alamb commented on PR #21766: URL: https://github.com/apache/datafusion/pull/21766#issuecomment-4327840196
> > This looks really cool @Dandandan -- please let me know when it is ready for review (or if you would like help, etc) > > I think the perf results look good - I think we mostly need to find out the right API that will also extend to further splitting/merging and other optimizations... I have an idea in - https://github.com/apache/datafusion/pull/21852 I probably won't have a chance to work on it until later this week but I think it is showing promise (as it separates IO/CPU in the parquet decoder). @HippoBarro's work upstream in arrow-rs / parquet will likely also make it easier -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
