schenksj commented on PR #4810:
URL:
https://github.com/apache/datafusion-comet/pull/4810#issuecomment-4879116263
Running benchmark: sparse selective build (membership pruning)
Running case: Spark
Stopped after 10 iterations, 2195 ms
Running case: Comet (dynamic filter off)
Stopped after 17 iterations, 2134 ms
Running case: Comet (dynamic filter on)
Stopped after 17 iterations, 2042 ms
OpenJDK 64-Bit Server VM 19.0.1+10-21 on Mac OS X 26.5
Apple M1
sparse selective build (membership pruning): Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------
Spark 190 220
17 88.5 11.3 1.0X
Comet (dynamic filter off) 110 126
15 153.0 6.5 1.7X
Comet (dynamic filter on) 99 120
17 169.0 5.9 1.9X
Running benchmark: clustered selective build (bounds pruning)
Running case: Spark
Stopped after 8 iterations, 2097 ms
Running case: Comet (dynamic filter off)
Stopped after 20 iterations, 2029 ms
Running case: Comet (dynamic filter on)
Stopped after 21 iterations, 2051 ms
OpenJDK 64-Bit Server VM 19.0.1+10-21 on Mac OS X 26.5
Apple M1
clustered selective build (bounds pruning): Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------
Spark 140 262
128 120.1 8.3 1.0X
Comet (dynamic filter off) 88 101
12 190.7 5.2 1.6X
Comet (dynamic filter on) 81 98
13 208.0 4.8 1.7X
Running benchmark: non-selective build (guard disables filter)
Running case: Spark
Stopped after 11 iterations, 2025 ms
Running case: Comet (dynamic filter off)
Stopped after 17 iterations, 2039 ms
Running case: Comet (dynamic filter on)
Stopped after 17 iterations, 2073 ms
OpenJDK 64-Bit Server VM 19.0.1+10-21 on Mac OS X 26.5
Apple M1
non-selective build (guard disables filter): Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------
Spark 173 184
13 96.9 10.3 1.0X
Comet (dynamic filter off) 108 120
12 154.9 6.5 1.6X
Comet (dynamic filter on) 104 122
11 160.9 6.2 1.7X
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
