jpountz commented on PR #12815:
URL: https://github.com/apache/lucene/pull/12815#issuecomment-1814493098
Here are results on `wikibigall`, none of the p-values seem significant:
```
TaskQPS baseline StdDevQPS
my_modified_version StdDev Pct diff p-value
CountTerm 12004.63 (5.0%) 11904.62
(4.7%) -0.8% ( -10% - 9%) 0.587
CountPhrase 4.09 (4.3%) 4.07
(3.1%) -0.7% ( -7% - 7%) 0.564
HighSloppyPhrase 1.64 (6.4%) 1.63
(6.1%) -0.7% ( -12% - 12%) 0.731
PKLookup 265.76 (2.0%) 264.07
(2.3%) -0.6% ( -4% - 3%) 0.353
HighSpanNear 2.77 (3.9%) 2.75
(4.5%) -0.6% ( -8% - 8%) 0.674
IntNRQ 93.16 (18.5%) 92.78
(18.9%) -0.4% ( -31% - 45%) 0.946
HighTermTitleSort 159.33 (3.8%) 158.74
(3.4%) -0.4% ( -7% - 7%) 0.743
LowSpanNear 15.07 (3.8%) 15.01
(3.9%) -0.3% ( -7% - 7%) 0.772
CountAndHighHigh 43.85 (2.3%) 43.70
(2.3%) -0.3% ( -4% - 4%) 0.656
HighTerm 375.32 (10.8%) 374.15
(9.2%) -0.3% ( -18% - 22%) 0.922
CountAndHighMed 128.64 (2.5%) 128.24
(2.4%) -0.3% ( -5% - 4%) 0.690
Or2Terms2StopWords 176.75 (2.0%) 176.20
(2.7%) -0.3% ( -4% - 4%) 0.680
MedSpanNear 3.84 (3.4%) 3.83
(3.5%) -0.2% ( -6% - 6%) 0.831
LowTerm 919.93 (7.1%) 918.19
(6.1%) -0.2% ( -12% - 14%) 0.928
MedSloppyPhrase 6.32 (2.9%) 6.32
(3.2%) -0.1% ( -6% - 6%) 0.882
MedTerm 524.29 (9.2%) 523.56
(7.9%) -0.1% ( -15% - 18%) 0.959
HighTermMonthSort 4464.58 (2.4%) 4459.71
(2.2%) -0.1% ( -4% - 4%) 0.882
AndHighLow 1148.77 (1.8%) 1147.57
(2.1%) -0.1% ( -3% - 3%) 0.864
Or3Terms 167.00 (1.7%) 166.86
(2.5%) -0.1% ( -4% - 4%) 0.903
Prefix3 304.76 (2.7%) 304.79
(2.6%) 0.0% ( -5% - 5%) 0.992
HighTermDayOfYearSort 402.33 (1.5%) 402.47
(1.1%) 0.0% ( -2% - 2%) 0.932
And2Terms2StopWords 160.21 (2.9%) 160.35
(2.7%) 0.1% ( -5% - 5%) 0.923
AndStopWords 29.69 (4.4%) 29.72
(3.7%) 0.1% ( -7% - 8%) 0.923
And3Terms 163.78 (2.1%) 164.10
(2.2%) 0.2% ( -4% - 4%) 0.775
LowSloppyPhrase 21.76 (2.4%) 21.81
(2.6%) 0.2% ( -4% - 5%) 0.771
Fuzzy2 78.46 (1.3%) 78.67
(1.2%) 0.3% ( -2% - 2%) 0.499
Respell 51.01 (1.5%) 51.18
(1.1%) 0.3% ( -2% - 2%) 0.405
OrHighMed 224.40 (2.0%) 225.31
(2.4%) 0.4% ( -3% - 4%) 0.565
Fuzzy1 84.21 (1.4%) 84.56
(1.3%) 0.4% ( -2% - 3%) 0.334
AndHighMed 147.38 (2.2%) 148.00
(2.0%) 0.4% ( -3% - 4%) 0.520
MedPhrase 16.34 (4.5%) 16.41
(2.6%) 0.4% ( -6% - 7%) 0.713
AndHighHigh 53.31 (3.5%) 53.54
(2.8%) 0.4% ( -5% - 6%) 0.666
OrHighRare 140.92 (6.6%) 141.60
(6.4%) 0.5% ( -11% - 14%) 0.813
LowPhrase 16.00 (5.2%) 16.08
(3.1%) 0.5% ( -7% - 9%) 0.707
OrHighHigh 64.07 (1.4%) 64.45
(1.9%) 0.6% ( -2% - 3%) 0.263
HighPhrase 42.14 (6.5%) 42.40
(3.5%) 0.6% ( -8% - 11%) 0.709
OrHighLow 758.38 (2.5%) 766.79
(2.5%) 1.1% ( -3% - 6%) 0.156
Wildcard 42.37 (2.9%) 42.86
(2.2%) 1.1% ( -3% - 6%) 0.160
OrStopWords 33.23 (5.3%) 33.81
(4.0%) 1.7% ( -7% - 11%) 0.244
CountOrHighMed 80.75 (1.3%) 87.22
(16.4%) 8.0% ( -9% - 26%) 0.030
CountOrHighHigh 51.80 (1.1%) 56.12
(16.9%) 8.3% ( -9% - 26%) 0.027
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org
