jpountz commented on PR #14080:
URL: https://github.com/apache/lucene/pull/14080#issuecomment-2551649936
I made the heuristic more conservative, results now look like this on my M3
after a few iterations:
```
TaskQPS baseline StdDevQPS
my_modified_version StdDev Pct diff p-value
Wildcard 190.37 (4.6%) 184.79
(5.9%) -2.9% ( -12% - 7%) 0.432
FilteredOrHighHigh 95.26 (5.4%) 92.73
(3.5%) -2.7% ( -10% - 6%) 0.407
PKLookup 392.08 (4.1%) 382.21
(5.5%) -2.5% ( -11% - 7%) 0.460
Prefix3 344.05 (1.5%) 335.95
(3.4%) -2.4% ( -7% - 2%) 0.206
TermDTSort 350.30 (4.9%) 344.70
(5.6%) -1.6% ( -11% - 9%) 0.668
FilteredOrHighMed 249.33 (4.9%) 245.53
(3.3%) -1.5% ( -9% - 7%) 0.607
FilteredOrStopWords 68.15 (5.0%) 67.11
(2.6%) -1.5% ( -8% - 6%) 0.587
TermDayOfYearSort 2881.75 (3.9%) 2841.87
(4.2%) -1.4% ( -9% - 6%) 0.628
Respell 146.40 (1.5%) 144.40
(2.8%) -1.4% ( -5% - 3%) 0.393
FilteredOr3Terms 254.32 (4.3%) 251.02
(3.7%) -1.3% ( -8% - 6%) 0.646
TermGroup1M 35.51 (3.2%) 35.05
(2.2%) -1.3% ( -6% - 4%) 0.504
FilteredOr2Terms2StopWords 250.63 (3.9%) 248.29
(3.0%) -0.9% ( -7% - 6%) 0.704
FilteredOrMany 19.83 (3.2%) 19.64
(4.0%) -0.9% ( -7% - 6%) 0.720
FilteredAnd3Terms 296.45 (4.1%) 293.86
(6.0%) -0.9% ( -10% - 9%) 0.810
FilteredAnd2Terms2StopWords 276.61 (3.8%) 274.23
(6.0%) -0.9% ( -10% - 9%) 0.810
Fuzzy2 158.83 (1.8%) 157.60
(2.3%) -0.8% ( -4% - 3%) 0.601
CombinedOrHighMed 113.92 (2.0%) 113.15
(2.0%) -0.7% ( -4% - 3%) 0.636
TermBGroup1M 43.16 (4.1%) 42.87
(3.2%) -0.7% ( -7% - 6%) 0.796
TermBGroup1M1P 60.47 (2.0%) 60.06
(2.8%) -0.7% ( -5% - 4%) 0.701
FilteredAndStopWords 52.74 (6.8%) 52.43
(9.1%) -0.6% ( -15% - 16%) 0.918
Fuzzy1 198.72 (2.4%) 197.56
(2.9%) -0.6% ( -5% - 4%) 0.754
FilteredAndHighMed 181.55 (3.8%) 180.71
(5.1%) -0.5% ( -8% - 8%) 0.884
TermTitleSort 154.88 (7.2%) 154.35
(3.3%) -0.3% ( -10% - 10%) 0.931
CountTerm 20770.14 (5.1%) 20709.54
(3.6%) -0.3% ( -8% - 8%) 0.925
CombinedOrHighHigh 27.80 (2.5%) 27.75
(2.9%) -0.2% ( -5% - 5%) 0.931
And2Terms2StopWords 279.13 (4.4%) 278.82
(1.5%) -0.1% ( -5% - 6%) 0.961
AndHighOrMedMed 71.54 (3.3%) 71.69
(3.7%) 0.2% ( -6% - 7%) 0.931
FilteredPhrase 48.21 (2.2%) 48.35
(1.1%) 0.3% ( -2% - 3%) 0.815
TermGroup10K 35.71 (4.9%) 35.84
(2.6%) 0.4% ( -6% - 8%) 0.896
CountFilteredPhrase 47.87 (3.9%) 48.04
(2.7%) 0.4% ( -5% - 7%) 0.876
FilteredAndHighHigh 79.12 (5.3%) 79.46
(7.8%) 0.4% ( -12% - 14%) 0.928
CountOrHighHigh 113.80 (1.3%) 114.40
(1.4%) 0.5% ( -2% - 3%) 0.588
CountOrHighMed 213.82 (2.3%) 215.45
(1.9%) 0.8% ( -3% - 5%) 0.609
TermGroup100 38.49 (6.1%) 38.79
(4.3%) 0.8% ( -9% - 11%) 0.836
OrMany 27.84 (6.3%) 28.07
(3.8%) 0.8% ( -8% - 11%) 0.826
And3Terms 252.72 (3.3%) 254.82
(2.3%) 0.8% ( -4% - 6%) 0.674
CombinedAndHighHigh 15.06 (2.8%) 15.21
(4.8%) 1.0% ( -6% - 8%) 0.721
CombinedTerm 52.24 (1.0%) 52.88
(3.1%) 1.2% ( -2% - 5%) 0.445
AndStopWords 39.29 (4.0%) 39.81
(3.2%) 1.3% ( -5% - 8%) 0.613
OrStopWords 49.24 (4.5%) 49.94
(2.2%) 1.4% ( -5% - 8%) 0.572
AndHighMed 194.03 (3.9%) 197.15
(1.1%) 1.6% ( -3% - 6%) 0.430
CountPhrase 7.17 (4.1%) 7.28
(2.3%) 1.6% ( -4% - 8%) 0.484
CombinedAndHighMed 49.90 (3.9%) 50.76
(4.6%) 1.7% ( -6% - 10%) 0.565
DismaxOrHighHigh 185.41 (3.4%) 188.65
(2.6%) 1.7% ( -4% - 7%) 0.410
AndHighHigh 74.90 (4.1%) 76.32
(1.7%) 1.9% ( -3% - 8%) 0.397
OrHighRare 538.41 (3.4%) 548.78
(7.7%) 1.9% ( -8% - 13%) 0.649
DismaxOrHighMed 276.14 (3.7%) 281.50
(1.8%) 1.9% ( -3% - 7%) 0.345
Or3Terms 243.51 (4.5%) 248.53
(0.7%) 2.1% ( -3% - 7%) 0.368
AndMedOrHighHigh 79.94 (8.7%) 81.70
(4.1%) 2.2% ( -9% - 16%) 0.647
Or2Terms2StopWords 268.15 (4.0%) 274.04
(1.9%) 2.2% ( -3% - 8%) 0.325
FilteredTerm 255.82 (2.0%) 261.55
(0.4%) 2.2% ( 0% - 4%) 0.026
OrHighHigh 76.05 (4.7%) 77.89
(1.7%) 2.4% ( -3% - 9%) 0.332
OrHighMed 307.88 (4.7%) 316.45
(2.5%) 2.8% ( -4% - 10%) 0.299
IntNRQ 198.18 (3.2%) 203.97
(5.7%) 2.9% ( -5% - 12%) 0.372
Phrase 22.91 (6.4%) 23.67
(3.5%) 3.3% ( -6% - 14%) 0.367
Term 869.72 (4.6%) 898.83
(1.5%) 3.3% ( -2% - 9%) 0.170
TermMonthSort 427.24 (6.1%) 449.10
(4.1%) 5.1% ( -4% - 16%) 0.163
DismaxTerm 810.59 (10.7%) 873.11
(4.1%) 7.7% ( -6% - 25%) 0.180
CountFilteredOrHighHigh 82.81 (2.6%) 89.79
(1.0%) 8.4% ( 4% - 12%) 0.000
CountAndHighMed 207.79 (2.4%) 247.26
(3.6%) 19.0% ( 12% - 25%) 0.000
CountFilteredOrMany 9.51 (2.7%) 11.32
(1.1%) 19.0% ( 14% - 23%) 0.000
CountFilteredOrHighMed 100.08 (1.9%) 123.90
(1.1%) 23.8% ( 20% - 27%) 0.000
CountAndHighHigh 67.56 (1.9%) 120.00
(2.1%) 77.6% ( 72% - 83%) 0.000
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org
