Smith-Cruise opened a new issue, #1864: URL: https://github.com/apache/iceberg-rust/issues/1864
### Is your feature request related to a problem or challenge? I'm using DataFusion to integrate `iceberg-rust` and `delta-rs`. However, I found that the performance of `iceberg-rust` is not ideal. I've built a simple benchmark on my machine, TPCH SF100 parquet lineitem fully scan. `select * from catalog.tpch_sf100.lineitem order by 1 limit 1`; iceberg-rust: 104s delta-rs: 40s In the iceberg-rust, it looks like we can't parallel scan. The CPU's utilization is very low. Sometimes, only one core is 100%. Could anyone help me find the root cause? ### Describe the solution you'd like _No response_ ### Willingness to contribute I would be willing to contribute to this feature with guidance from the Iceberg Rust community -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
