Braedon-Wooding-Displayr opened a new pull request, #26476:
URL: https://github.com/apache/datafusion/pull/26476

   ## Which issue does this PR close?
   
   <!--
   We generally require a GitHub issue to be filed for all bug fixes and 
enhancements and this helps us generate change logs for our releases. You can 
link an issue to this PR using the GitHub syntax. For example `Closes #123` 
indicates that this PR will close issue #123.
   -->
   
   - Closes #26475
   
   ## Rationale for this change
   
   If row-group statistics or Bloom filters prune every row group in a file 
range, the opener still builds the decoder read plans, the decoder and the row 
filter, then hands back a stream morsel that yields nothing. `PruneFile` 
already ends early when file statistics prune the range; this does the same 
once row-group pruning has.
   
   ## What changes are included in this PR?
   
   `PruneWithStatistics` and `PruneWithBloomFilters` return 
`ParquetOpenState::Done` when no row group survives. 
   
   ## What is the testing strategy for this PR?
   
   Testing to ensure that we do actually skip them!
   
   ## Are there any user-facing changes?
   
   Nope!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to