xudong963 commented on code in PR #21637:
URL: https://github.com/apache/datafusion/pull/21637#discussion_r3199127552
##########
datafusion/datasource-parquet/src/metrics.rs:
##########
@@ -67,6 +68,11 @@ pub struct ParquetFileMetrics {
pub page_index_rows_pruned: PruningMetrics,
/// Total pages filtered or matched by parquet page index
pub page_index_pages_pruned: PruningMetrics,
+ /// Lazily registered counter for pages whose page-index pruning was
skipped
+ /// because the containing row group was fully matched by row-group
statistics.
+ ///
+ /// These pages are still scanned; only page-index predicate evaluation is
skipped.
+ page_index_pages_skipped_by_fully_matched: LazyParquetSummaryCount,
Review Comment:
It is registered lazily so normal Parquet scans do not show an extra
`page_index_pages_skipped_by_fully_matched=0` metric.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
