stefanvodita commented on PR #12995:
URL: https://github.com/apache/lucene/pull/12995#issuecomment-1883476554
The results are in. I don't see any significant p-values (< 0.05).
`python3 src/python/localrun.py -source wikimediumall -r`
```
TaskQPS baseline StdDevQPS
my_modified_version StdDev Pct diff p-value
MedPhrase 27.55 (7.2%) 27.08
(5.8%) -1.7% ( -13% - 12%) 0.408
IntNRQ 19.20 (10.6%) 18.89
(7.1%) -1.6% ( -17% - 18%) 0.566
BrowseMonthTaxoFacets 9.67 (8.9%) 9.52
(10.7%) -1.6% ( -19% - 19%) 0.613
BrowseRandomLabelTaxoFacets 4.01 (25.1%) 3.97
(26.0%) -1.0% ( -41% - 66%) 0.902
HighSloppyPhrase 28.64 (3.5%) 28.41
(2.4%) -0.8% ( -6% - 5%) 0.406
AndHighLow 325.06 (3.8%) 322.67
(7.0%) -0.7% ( -11% - 10%) 0.680
BrowseRandomLabelSSDVFacets 2.92 (1.8%) 2.90
(2.6%) -0.6% ( -4% - 3%) 0.403
BrowseDayOfYearSSDVFacets 4.08 (3.8%) 4.06
(3.7%) -0.6% ( -7% - 7%) 0.625
Prefix3 142.86 (5.0%) 142.32
(5.4%) -0.4% ( -10% - 10%) 0.819
HighTermTitleBDVSort 7.40 (6.3%) 7.38
(6.4%) -0.3% ( -12% - 13%) 0.862
LowSloppyPhrase 11.47 (1.9%) 11.44
(1.7%) -0.3% ( -3% - 3%) 0.657
LowSpanNear 6.86 (2.0%) 6.85
(1.8%) -0.2% ( -3% - 3%) 0.754
HighPhrase 67.07 (3.1%) 66.94
(3.1%) -0.2% ( -6% - 6%) 0.850
LowPhrase 7.77 (3.2%) 7.76
(3.4%) -0.1% ( -6% - 6%) 0.888
HighSpanNear 3.81 (3.0%) 3.80
(2.8%) -0.1% ( -5% - 5%) 0.875
HighIntervalsOrdered 1.61 (2.5%) 1.61
(2.4%) -0.1% ( -4% - 4%) 0.853
AndHighMed 76.92 (6.7%) 76.83
(8.0%) -0.1% ( -13% - 15%) 0.959
MedSloppyPhrase 15.30 (1.9%) 15.29
(1.7%) -0.1% ( -3% - 3%) 0.850
OrHighHigh 20.33 (7.3%) 20.31
(6.4%) -0.1% ( -12% - 14%) 0.961
LowIntervalsOrdered 7.12 (2.5%) 7.12
(2.4%) -0.0% ( -4% - 4%) 0.955
AndHighMedDayTaxoFacets 11.03 (2.2%) 11.04
(2.2%) 0.0% ( -4% - 4%) 0.959
OrNotHighMed 216.20 (2.6%) 216.28
(3.0%) 0.0% ( -5% - 5%) 0.967
MedIntervalsOrdered 23.70 (1.8%) 23.71
(1.6%) 0.0% ( -3% - 3%) 0.944
MedSpanNear 13.33 (1.9%) 13.34
(1.7%) 0.1% ( -3% - 3%) 0.910
AndHighHighDayTaxoFacets 7.73 (3.5%) 7.74
(3.2%) 0.1% ( -6% - 7%) 0.906
MedTermDayTaxoFacets 15.49 (2.2%) 15.54
(1.6%) 0.3% ( -3% - 4%) 0.590
HighTermTitleSort 121.92 (1.8%) 122.33
(1.6%) 0.3% ( -2% - 3%) 0.533
TermDTSort 142.74 (2.1%) 143.26
(3.4%) 0.4% ( -5% - 5%) 0.683
PKLookup 172.65 (3.0%) 173.29
(2.8%) 0.4% ( -5% - 6%) 0.687
Respell 43.69 (2.3%) 43.87
(2.7%) 0.4% ( -4% - 5%) 0.613
HighTermDayOfYearSort 210.29 (2.8%) 211.25
(3.1%) 0.5% ( -5% - 6%) 0.626
AndHighHigh 23.87 (11.4%) 23.99
(11.7%) 0.5% ( -20% - 26%) 0.888
BrowseDateSSDVFacets 1.19 (5.2%) 1.19
(4.2%) 0.6% ( -8% - 10%) 0.698
Wildcard 186.59 (2.6%) 187.68
(2.9%) 0.6% ( -4% - 6%) 0.505
OrHighMed 90.56 (5.3%) 91.09
(4.9%) 0.6% ( -9% - 11%) 0.715
OrNotHighHigh 354.86 (3.6%) 356.98
(3.9%) 0.6% ( -6% - 8%) 0.611
OrHighNotHigh 306.95 (3.8%) 308.88
(4.2%) 0.6% ( -7% - 9%) 0.620
OrHighNotMed 363.76 (3.9%) 366.46
(4.0%) 0.7% ( -6% - 8%) 0.548
BrowseDateTaxoFacets 4.97 (27.3%) 5.00
(27.3%) 0.8% ( -42% - 76%) 0.929
BrowseDayOfYearTaxoFacets 5.06 (26.8%) 5.09
(26.9%) 0.8% ( -41% - 74%) 0.927
OrHighNotLow 244.26 (5.3%) 246.17
(5.3%) 0.8% ( -9% - 12%) 0.641
BrowseMonthSSDVFacets 4.38 (3.9%) 4.41
(3.1%) 0.8% ( -5% - 8%) 0.479
OrHighLow 264.51 (5.4%) 266.91
(4.5%) 0.9% ( -8% - 11%) 0.568
HighTermMonthSort 2111.04 (1.9%) 2131.88
(3.2%) 1.0% ( -4% - 6%) 0.236
OrNotHighLow 543.72 (2.9%) 549.12
(2.3%) 1.0% ( -4% - 6%) 0.229
Fuzzy2 51.05 (2.7%) 51.61
(2.6%) 1.1% ( -4% - 6%) 0.191
Fuzzy1 66.48 (3.0%) 67.31
(3.1%) 1.3% ( -4% - 7%) 0.199
MedTerm 508.60 (7.4%) 515.34
(7.2%) 1.3% ( -12% - 17%) 0.568
HighTerm 399.43 (7.2%) 405.35
(7.0%) 1.5% ( -11% - 16%) 0.509
OrHighMedDayTaxoFacets 3.92 (4.2%) 3.98
(3.4%) 1.6% ( -5% - 9%) 0.194
LowTerm 350.89 (8.4%) 358.77
(9.4%) 2.2% ( -14% - 21%) 0.427
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org
