YinZheng-Sun opened a new issue, #946:
URL: https://github.com/apache/iceberg-cpp/issues/946
In iceberg-cpp, Parquet scan currently prunes at file/manifest level;
row-group statistics and Parquet page index are not yet used to skip pages
inside retained row groups. For large row groups with data sorted by filter
column, this leaves significant I/O on the table.
I’d like to propose a phased design:
(1) consolidate row-group stats pruning
(2) add ColumnIndex/OffsetIndex-based page skipping
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
