advancedxy commented on issue #946: URL: https://github.com/apache/iceberg-cpp/issues/946#issuecomment-5788358685
@YinZheng-Sun I think we can create an epic issue to track the read performance/data skipping capability. Java-Iceberg has bloom filter and dictionary filter except for row group filter. And we could add late materialization to the iceberg-cpp side also as it's crucial to performance of OLAP engines and similar system(such as arrow-rs/parquet-rs) already implemented LM. Although, LM might take much longer and engineering effort. WDYT? @wgtmac P.S: I work with @YinZheng-Sun and we are evaluating iceberg-cpp to read/write iceberg tables with our internal OLAP engines. We would like to contribute back to iceberg-cpp as we find issues and solve related problems. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
