alamb commented on PR #21834:
URL: https://github.com/apache/datafusion/pull/21834#issuecomment-4327958660
BTW one thing I noticed while running this locally is that some of the
benchmarks take a while (45s for example) -- maybe it is worth cranking the
sizes down somehow (or maybe you are going to optimize it so much that these
benchmarks will be much faster and less than 5 s in the figure 😆 )
> Warning: Unable to complete 100 samples in 5.0s. You may wish to increase
target time to 8.7s, enable flat sampling, or reduce sample count to 50.
```
Gnuplot not found, using plotters backend
Benchmarking array_remove_int64/remove/10: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase
target time to 8.7s, enable flat sampling, or reduce sample count to 50.
array_remove_int64/remove/10
time: [1.7197 ms 1.7241 ms 1.7293 ms]
Found 5 outliers among 100 measurements (5.00%)
1 (1.00%) low mild
2 (2.00%) high mild
2 (2.00%) high severe
array_remove_int64/remove/100
time: [2.8139 ms 2.8184 ms 2.8234 ms]
Found 3 outliers among 100 measurements (3.00%)
1 (1.00%) high mild
2 (2.00%) high severe
array_remove_int64/remove/500
time: [6.3946 ms 6.4057 ms 6.4172 ms]
Found 3 outliers among 100 measurements (3.00%)
3 (3.00%) high mild
Benchmarking array_remove_n_int64/remove/10: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase
target time to 9.0s, enable flat sampling, or reduce sample count to 50.
array_remove_n_int64/remove/10
time: [1.7368 ms 1.7413 ms 1.7458 ms]
Found 3 outliers among 100 measurements (3.00%)
1 (1.00%) low mild
2 (2.00%) high mild
array_remove_n_int64/remove/100
time: [3.4923 ms 3.5019 ms 3.5127 ms]
Found 4 outliers among 100 measurements (4.00%)
2 (2.00%) high mild
2 (2.00%) high severe
array_remove_n_int64/remove/500
time: [10.447 ms 10.491 ms 10.546 ms]
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high severe
Benchmarking array_remove_all_int64/remove/10: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase
target time to 8.7s, enable flat sampling, or reduce sample count to 50.
array_remove_all_int64/remove/10
time: [1.7101 ms 1.7144 ms 1.7191 ms]
array_remove_all_int64/remove/100
time: [4.2635 ms 4.2727 ms 4.2822 ms]
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
array_remove_all_int64/remove/500
time: [14.608 ms 14.634 ms 14.663 ms]
Found 10 outliers among 100 measurements (10.00%)
4 (4.00%) high mild
6 (6.00%) high severe
array_remove_int64_nested/remove/10
time: [13.310 ms 13.336 ms 13.365 ms]
Found 10 outliers among 100 measurements (10.00%)
9 (9.00%) high mild
1 (1.00%) high severe
Benchmarking array_remove_int64_nested/remove/100: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase
target time to 9.7s, or reduce sample count to 50.
array_remove_int64_nested/remove/100
time: [96.202 ms 96.427 ms 96.668 ms]
Found 5 outliers among 100 measurements (5.00%)
4 (4.00%) high mild
1 (1.00%) high severe
Benchmarking array_remove_int64_nested/remove/500: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase
target time to 45.7s, or reduce sample count to 10.
array_remove_int64_nested/remove/500
time: [458.77 ms 459.64 ms 460.55 ms]
Found 5 outliers among 100 measurements (5.00%)
5 (5.00%) high mild
array_remove_n_int64_nested/remove/10
time: [12.978 ms 13.010 ms 13.044 ms]
Found 9 outliers among 100 measurements (9.00%)
9 (9.00%) high mild
Benchmarking array_remove_n_int64_nested/remove/100: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase
target time to 9.7s, or reduce sample count to 50.
array_remove_n_int64_nested/remove/100
time: [96.835 ms 97.071 ms 97.312 ms]
Benchmarking array_remove_n_int64_nested/remove/500: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase
target time to 46.4s, or reduce sample count to 10.
array_remove_n_int64_nested/remove/500
time: [462.36 ms 463.38 ms 464.41 ms]
Found 3 outliers among 100 measurements (3.00%)
3 (3.00%) high mild
array_remove_all_int64_nested/remove/10
time: [13.394 ms 13.458 ms 13.525 ms]
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
Benchmarking array_remove_all_int64_nested/remove/100: Warming up for 3.0000
s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase
target time to 9.8s, or reduce sample count to 50.
array_remove_all_int64_nested/remove/100
time: [98.061 ms 98.235 ms 98.419 ms]
Found 5 outliers among 100 measurements (5.00%)
5 (5.00%) high mild
Benchmarking array_remove_all_int64_nested/remove/500: Warming up for 3.0000
s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase
target time to 46.9s, or reduce sample count to 10.
array_remove_all_int64_nested/remove/500
time: [467.30 ms 468.04 ms 468.83 ms]
Found 5 outliers among 100 measurements (5.00%)
5 (5.00%) high mild
array_remove_strings/remove/10
time: [2.2993 ms 2.3036 ms 2.3083 ms]
Found 11 outliers among 100 measurements (11.00%)
9 (9.00%) high mild
2 (2.00%) high severe
array_remove_strings/remove/100
time: [7.3539 ms 7.3798 ms 7.4067 ms]
array_remove_strings/remove/500
time: [28.950 ms 29.016 ms 29.093 ms]
Found 11 outliers among 100 measurements (11.00%)
8 (8.00%) high mild
3 (3.00%) high severe
Benchmarking array_remove_boolean/remove/10: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase
target time to 8.4s, enable flat sampling, or reduce sample count to 50.
array_remove_boolean/remove/10
time: [1.6409 ms 1.6442 ms 1.6479 ms]
Found 9 outliers among 100 measurements (9.00%)
7 (7.00%) high mild
2 (2.00%) high severe
array_remove_boolean/remove/100
time: [2.9571 ms 2.9626 ms 2.9686 ms]
Found 12 outliers among 100 measurements (12.00%)
4 (4.00%) high mild
8 (8.00%) high severe
array_remove_boolean/remove/500
time: [7.6144 ms 7.6307 ms 7.6475 ms]
Benchmarking array_remove_fixed_size_binary/remove/10: Warming up for 3.0000
s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase
target time to 9.5s, enable flat sampling, or reduce sample count to 50.
array_remove_fixed_size_binary/remove/10
time: [1.8812 ms 1.8872 ms 1.8937 ms]
Found 5 outliers among 100 measurements (5.00%)
4 (4.00%) high mild
1 (1.00%) high severe
array_remove_fixed_size_binary/remove/100
time: [4.8745 ms 4.8843 ms 4.8949 ms]
Found 14 outliers among 100 measurements (14.00%)
12 (12.00%) high mild
2 (2.00%) high severe
array_remove_fixed_size_binary/remove/500
time: [18.366 ms 18.398 ms 18.434 ms]
Found 11 outliers among 100 measurements (11.00%)
8 (8.00%) high mild
3 (3.00%) high severe
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
