zacharymorn commented on pull request #101:
URL: https://github.com/apache/lucene/pull/101#issuecomment-829928067
2 luceneutil runs with wikimedium5m results:
```
TaskQPS baseline StdDevQPS my_modified_version
StdDev Pct diff p-value
OrHighMed 196.58 (3.5%) 134.01 (2.5%)
-31.8% ( -36% - -26%) 0.000
OrHighHigh 43.32 (2.0%) 31.45 (2.0%)
-27.4% ( -30% - -23%) 0.000
Fuzzy1 94.71 (14.2%) 89.31 (16.9%)
-5.7% ( -32% - 29%) 0.249
OrHighLow 549.71 (4.7%) 521.55 (5.8%)
-5.1% ( -14% - 5%) 0.002
HighTermDayOfYearSort 284.66 (11.4%) 274.13 (11.4%)
-3.7% ( -23% - 21%) 0.304
HighTerm 1392.83 (4.6%) 1352.76 (4.7%)
-2.9% ( -11% - 6%) 0.050
HighPhrase 199.03 (2.8%) 193.93 (3.0%)
-2.6% ( -8% - 3%) 0.006
TermDTSort 200.40 (10.9%) 196.04 (13.2%)
-2.2% ( -23% - 24%) 0.570
OrNotHighLow 1137.55 (3.8%) 1114.38 (4.8%)
-2.0% ( -10% - 6%) 0.138
OrNotHighMed 874.47 (5.8%) 857.02 (5.3%)
-2.0% ( -12% - 9%) 0.259
HighTermMonthSort 285.86 (16.9%) 280.37 (15.4%)
-1.9% ( -29% - 36%) 0.707
OrHighNotLow 797.17 (5.2%) 782.04 (5.5%)
-1.9% ( -11% - 9%) 0.263
AndHighMed 259.03 (3.2%) 254.45 (4.8%)
-1.8% ( -9% - 6%) 0.169
LowTerm 1619.44 (3.4%) 1592.71 (4.4%)
-1.7% ( -9% - 6%) 0.184
MedTerm 1448.09 (3.7%) 1432.36 (4.6%)
-1.1% ( -9% - 7%) 0.413
LowPhrase 530.26 (3.0%) 524.77 (3.8%)
-1.0% ( -7% - 6%) 0.343
Wildcard 237.52 (1.7%) 235.18 (2.1%)
-1.0% ( -4% - 2%) 0.104
PKLookup 226.73 (2.8%) 224.67 (2.5%)
-0.9% ( -6% - 4%) 0.277
AndHighHigh 167.49 (3.4%) 166.40 (2.7%)
-0.6% ( -6% - 5%) 0.505
MedSloppyPhrase 52.92 (1.9%) 52.60 (2.2%)
-0.6% ( -4% - 3%) 0.339
MedSpanNear 128.06 (2.0%) 127.34 (2.3%)
-0.6% ( -4% - 3%) 0.405
AndHighLow 1016.64 (3.9%) 1011.41 (4.2%)
-0.5% ( -8% - 7%) 0.689
Prefix3 333.77 (3.9%) 332.40 (4.0%)
-0.4% ( -8% - 7%) 0.742
LowSpanNear 45.55 (2.6%) 45.37 (2.6%)
-0.4% ( -5% - 4%) 0.636
HighTermTitleBDVSort 152.08 (15.6%) 151.52 (14.8%)
-0.4% ( -26% - 35%) 0.938
HighIntervalsOrdered 23.28 (1.9%) 23.20 (2.4%)
-0.4% ( -4% - 3%) 0.597
HighSloppyPhrase 276.19 (2.4%) 275.46 (2.8%)
-0.3% ( -5% - 5%) 0.749
BrowseMonthTaxoFacets 13.43 (2.7%) 13.40 (3.0%)
-0.2% ( -5% - 5%) 0.827
OrNotHighHigh 730.45 (6.8%) 729.04 (5.1%)
-0.2% ( -11% - 12%) 0.919
IntNRQ 137.68 (16.3%) 137.51 (16.6%)
-0.1% ( -28% - 39%) 0.981
OrHighNotHigh 629.90 (4.9%) 630.02 (5.0%)
0.0% ( -9% - 10%) 0.990
LowSloppyPhrase 20.78 (1.2%) 20.79 (1.7%)
0.1% ( -2% - 3%) 0.895
Respell 117.77 (2.5%) 117.85 (2.4%)
0.1% ( -4% - 5%) 0.930
BrowseDayOfYearSSDVFacets 28.73 (2.6%) 28.75 (2.6%)
0.1% ( -4% - 5%) 0.930
MedPhrase 51.36 (3.1%) 51.41 (2.1%)
0.1% ( -4% - 5%) 0.902
HighSpanNear 3.58 (2.2%) 3.58 (2.8%)
0.2% ( -4% - 5%) 0.835
Fuzzy2 20.57 (4.2%) 20.66 (3.5%)
0.5% ( -6% - 8%) 0.710
OrHighNotMed 753.94 (6.4%) 758.23 (5.1%)
0.6% ( -10% - 12%) 0.756
BrowseDateTaxoFacets 11.29 (3.1%) 11.35 (3.0%)
0.6% ( -5% - 6%) 0.547
BrowseMonthSSDVFacets 31.97 (6.9%) 32.21 (5.4%)
0.8% ( -10% - 13%) 0.698
BrowseDayOfYearTaxoFacets 11.30 (3.0%) 11.38 (3.1%)
0.8% ( -5% - 7%) 0.427
```
```
TaskQPS baseline StdDevQPS my_modified_version
StdDev Pct diff p-value
OrHighHigh 77.68 (3.2%) 36.44 (3.3%)
-53.1% ( -57% - -48%) 0.000
OrHighMed 265.36 (4.9%) 148.05 (2.9%)
-44.2% ( -49% - -38%) 0.000
OrHighLow 563.62 (6.2%) 392.94 (3.6%)
-30.3% ( -37% - -21%) 0.000
OrHighNotHigh 647.72 (6.3%) 625.42 (7.9%)
-3.4% ( -16% - 11%) 0.126
IntNRQ 422.98 (3.5%) 410.61 (6.9%)
-2.9% ( -12% - 7%) 0.091
OrHighNotLow 840.72 (7.0%) 818.98 (4.4%)
-2.6% ( -13% - 9%) 0.162
HighTerm 1464.33 (4.7%) 1428.42 (5.3%)
-2.5% ( -11% - 7%) 0.119
MedPhrase 486.70 (4.1%) 478.83 (3.3%)
-1.6% ( -8% - 6%) 0.171
OrHighNotMed 738.23 (5.9%) 726.30 (7.4%)
-1.6% ( -14% - 12%) 0.444
OrNotHighHigh 713.95 (4.5%) 703.94 (5.2%)
-1.4% ( -10% - 8%) 0.358
BrowseDateTaxoFacets 10.78 (3.6%) 10.63 (4.1%)
-1.4% ( -8% - 6%) 0.260
MedTerm 1709.93 (4.8%) 1686.84 (5.8%)
-1.4% ( -11% - 9%) 0.422
LowTerm 1836.19 (5.4%) 1811.93 (6.6%)
-1.3% ( -12% - 11%) 0.491
BrowseDayOfYearTaxoFacets 10.80 (3.8%) 10.66 (4.0%)
-1.3% ( -8% - 6%) 0.309
HighPhrase 40.45 (2.7%) 39.99 (2.5%)
-1.1% ( -6% - 4%) 0.160
BrowseMonthTaxoFacets 13.11 (2.6%) 12.98 (3.2%)
-1.0% ( -6% - 4%) 0.254
HighSloppyPhrase 32.04 (5.6%) 31.70 (4.9%)
-1.0% ( -10% - 10%) 0.535
TermDTSort 431.47 (12.5%) 427.83 (13.2%)
-0.8% ( -23% - 28%) 0.836
Wildcard 289.98 (7.5%) 287.96 (5.3%)
-0.7% ( -12% - 13%) 0.735
PKLookup 217.64 (3.8%) 216.31 (3.2%)
-0.6% ( -7% - 6%) 0.580
HighIntervalsOrdered 4.21 (2.6%) 4.20 (3.0%)
-0.4% ( -5% - 5%) 0.638
BrowseDayOfYearSSDVFacets 27.75 (2.6%) 27.64 (2.3%)
-0.4% ( -5% - 4%) 0.589
AndHighMed 227.13 (2.3%) 226.33 (3.9%)
-0.4% ( -6% - 5%) 0.729
AndHighHigh 110.85 (2.4%) 110.49 (3.1%)
-0.3% ( -5% - 5%) 0.709
Prefix3 235.98 (3.2%) 235.41 (2.2%)
-0.2% ( -5% - 5%) 0.787
LowSpanNear 45.89 (1.7%) 45.78 (1.6%)
-0.2% ( -3% - 3%) 0.663
LowSloppyPhrase 24.25 (3.7%) 24.21 (3.5%)
-0.2% ( -7% - 7%) 0.867
HighSpanNear 50.67 (3.8%) 50.59 (4.0%)
-0.2% ( -7% - 7%) 0.902
LowPhrase 576.08 (4.7%) 575.26 (5.2%)
-0.1% ( -9% - 10%) 0.928
OrNotHighMed 692.19 (6.3%) 691.63 (5.1%)
-0.1% ( -10% - 12%) 0.965
Fuzzy2 30.66 (4.3%) 30.64 (2.9%)
-0.1% ( -7% - 7%) 0.949
MedSpanNear 23.95 (2.0%) 23.95 (2.2%)
-0.0% ( -4% - 4%) 0.992
MedSloppyPhrase 36.54 (5.7%) 36.57 (4.2%)
0.1% ( -9% - 10%) 0.962
BrowseMonthSSDVFacets 31.13 (5.1%) 31.20 (4.8%)
0.2% ( -9% - 10%) 0.888
HighTermTitleBDVSort 89.16 (8.9%) 89.37 (8.7%)
0.2% ( -15% - 19%) 0.934
Respell 83.91 (3.1%) 84.11 (2.7%)
0.2% ( -5% - 6%) 0.798
OrNotHighLow 1073.98 (6.5%) 1076.76 (6.1%)
0.3% ( -11% - 13%) 0.897
AndHighLow 905.72 (4.4%) 908.07 (5.2%)
0.3% ( -8% - 10%) 0.864
Fuzzy1 81.24 (12.0%) 81.73 (9.6%)
0.6% ( -18% - 25%) 0.861
HighTermDayOfYearSort 292.09 (15.6%) 294.83 (14.1%)
0.9% ( -24% - 36%) 0.842
HighTermMonthSort 71.72 (11.6%) 74.49 (17.1%)
3.9% ( -22% - 36%) 0.403
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
