nealrichardson opened a new issue, #43659:
URL: https://github.com/apache/arrow/issues/43659

   ### Describe the enhancement requested
   
   From the Arrow workship at posit::conf 2024. Several participants reported 
that
   
   ```
   ds |>
     summarize(sum(some_filter_expression)) |>
     collect()
   ```
   
   was faster than
   
   ```
   ds |>
     filter(some_filter_expression) |>
     nrow()
   ```
   
   `nrow()` uses `Scanner$CountRows`: 
https://github.com/apache/arrow/blob/main/r/R/dplyr.R#L186
   
   We could replace that with something that runs an ExecPlan instead, as the 
comment above that line suggests, and perhaps that is more performant.
   
   cc @thisisnic @steph
   
   
   ### Component(s)
   
   R


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to