jpountz commented on PR #15151:
URL: https://github.com/apache/lucene/pull/15151#issuecomment-3250181785
wikibigall on my machine gives the following results:
```
TaskQPS baseline StdDevQPS
my_modified_version StdDev Pct diff p-value
FilteredOrStopWords 44.09 (2.0%) 43.68
(1.2%) -0.9% ( -4% - 2%) 0.070
FilteredPrefix3 147.21 (2.1%) 146.02
(2.0%) -0.8% ( -4% - 3%) 0.208
TermTitleSort 84.02 (3.4%) 83.45
(3.7%) -0.7% ( -7% - 6%) 0.543
CombinedOrHighHigh 21.82 (2.9%) 21.67
(3.2%) -0.7% ( -6% - 5%) 0.477
FilteredOrHighHigh 64.80 (1.9%) 64.38
(1.0%) -0.6% ( -3% - 2%) 0.170
CountPhrase 4.16 (1.8%) 4.13
(1.7%) -0.6% ( -4% - 2%) 0.269
CombinedTerm 37.20 (2.0%) 37.03
(2.6%) -0.5% ( -4% - 4%) 0.533
CombinedOrHighMed 82.29 (2.7%) 81.99
(3.3%) -0.4% ( -6% - 5%) 0.704
TermDTSort 383.61 (2.3%) 382.24
(2.7%) -0.4% ( -5% - 4%) 0.651
FilteredOr2Terms2StopWords 142.98 (1.4%) 142.64
(0.7%) -0.2% ( -2% - 1%) 0.498
TermMonthSort 3268.83 (2.6%) 3263.88
(2.8%) -0.2% ( -5% - 5%) 0.860
FilteredOr3Terms 161.33 (1.1%) 161.11
(0.8%) -0.1% ( -2% - 1%) 0.659
CountOrMany 28.41 (1.9%) 28.39
(3.2%) -0.1% ( -5% - 5%) 0.936
FilteredIntNRQ 296.73 (1.0%) 296.54
(1.2%) -0.1% ( -2% - 2%) 0.855
CountFilteredOrHighHigh 134.69 (1.0%) 134.61
(1.7%) -0.1% ( -2% - 2%) 0.901
CountAndHighMed 297.37 (1.3%) 297.31
(1.2%) -0.0% ( -2% - 2%) 0.958
CountAndHighHigh 350.18 (2.0%) 350.11
(3.8%) -0.0% ( -5% - 5%) 0.983
TermDayOfYearSort 282.87 (2.0%) 282.81
(1.4%) -0.0% ( -3% - 3%) 0.974
CountFilteredOrMany 26.60 (2.0%) 26.60
(3.1%) -0.0% ( -4% - 5%) 0.999
AndHighOrMedMed 48.78 (1.3%) 48.79
(1.2%) 0.0% ( -2% - 2%) 0.978
CountFilteredOrHighMed 146.46 (0.9%) 146.48
(1.2%) 0.0% ( -2% - 2%) 0.966
FilteredTerm 153.98 (2.2%) 154.04
(1.5%) 0.0% ( -3% - 3%) 0.941
FilteredOrHighMed 148.23 (1.3%) 148.37
(0.8%) 0.1% ( -1% - 2%) 0.777
OrHighRare 281.29 (8.3%) 281.70
(3.8%) 0.1% ( -10% - 13%) 0.943
FilteredOrMany 15.81 (2.0%) 15.83
(1.6%) 0.1% ( -3% - 3%) 0.799
CountOrHighHigh 332.30 (2.1%) 332.99
(4.0%) 0.2% ( -5% - 6%) 0.838
CountFilteredPhrase 24.86 (2.4%) 24.98
(1.3%) 0.5% ( -3% - 4%) 0.417
FilteredAndHighHigh 77.70 (1.8%) 78.09
(1.2%) 0.5% ( -2% - 3%) 0.293
OrMany 22.44 (4.3%) 22.55
(3.8%) 0.5% ( -7% - 8%) 0.682
CombinedAndHighHigh 22.19 (1.3%) 22.32
(1.6%) 0.6% ( -2% - 3%) 0.204
CountOrHighMed 339.36 (2.4%) 341.52
(1.9%) 0.6% ( -3% - 4%) 0.346
FilteredAnd2Terms2StopWords 212.32 (1.9%) 213.73
(1.4%) 0.7% ( -2% - 3%) 0.196
CombinedAndHighMed 84.39 (1.2%) 85.02
(1.6%) 0.7% ( -2% - 3%) 0.091
FilteredAnd3Terms 185.09 (2.9%) 186.51
(1.9%) 0.8% ( -3% - 5%) 0.321
FilteredPhrase 31.03 (1.5%) 31.27
(1.1%) 0.8% ( -1% - 3%) 0.059
FilteredAndStopWords 64.07 (2.0%) 64.58
(1.2%) 0.8% ( -2% - 4%) 0.120
Or3Terms 222.41 (6.2%) 224.23
(5.2%) 0.8% ( -10% - 13%) 0.653
CountTerm 8641.68 (4.1%) 8727.93
(4.3%) 1.0% ( -7% - 9%) 0.449
Or2Terms2StopWords 197.83 (5.0%) 199.85
(4.5%) 1.0% ( -8% - 11%) 0.496
OrHighMed 243.82 (7.2%) 246.48
(6.0%) 1.1% ( -11% - 15%) 0.602
FilteredAndHighMed 151.68 (3.8%) 153.36
(2.5%) 1.1% ( -5% - 7%) 0.279
AndMedOrHighHigh 80.46 (5.0%) 81.47
(4.1%) 1.3% ( -7% - 10%) 0.384
OrStopWords 46.75 (8.1%) 47.37
(6.8%) 1.3% ( -12% - 17%) 0.575
OrHighHigh 73.81 (9.1%) 74.95
(7.5%) 1.5% ( -13% - 19%) 0.558
And2Terms2StopWords 196.07 (6.2%) 199.96
(4.1%) 2.0% ( -7% - 13%) 0.235
And3Terms 228.82 (7.7%) 233.77
(5.2%) 2.2% ( -9% - 16%) 0.297
AndStopWords 44.61 (9.5%) 45.68
(6.4%) 2.4% ( -12% - 20%) 0.348
Term 617.63 (8.3%) 636.08
(5.3%) 3.0% ( -9% - 18%) 0.176
AndHighMed 188.71 (10.7%) 194.64
(7.2%) 3.1% ( -13% - 23%) 0.275
AndHighHigh 64.17 (11.8%) 66.29
(8.0%) 3.3% ( -14% - 26%) 0.300
```
p-values are high due to quite high run-over-run variance, but queries that
we'd have expected to get a speedup are at the bottom so it may give a tiny
speedup in practice.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
