liurenjie1024 commented on issue #265: URL: https://github.com/apache/iceberg-rust/issues/265#issuecomment-2014127366
I think this depends on the selectivity, and also the implementation. To achieve best performance, the scan reader need to perform vectorized execution to convert filter to selection vector(or visibility bitmap). I'm not 100% sure how parquet reader achieves this, but the interface shows that it's comparing values one by one? This maybe actually slow. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
