sdd opened a new pull request, #373: URL: https://github.com/apache/iceberg-rust/pull/373
This is a bit of an experiment to see how things could look if we tried to: - process Manifest Lists and Manifest Files concurrently rather than sequentially - process the stream of file scan tasks concurrently, streaming record batches from multiple files at the same time. I'd like to add some unit tests to confirm that this behaves as expected beyond the existing tests that we have for TableScan, and add an integration / performance test that can quantify any performance improvements (or regressions 😅 ) that we get from these changes. Let me know what you all think. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
