zacharymorn commented on pull request #101:
URL: https://github.com/apache/lucene/pull/101#issuecomment-830494893
2 luceneutil runs with wikimedium5m results:
```
TaskQPS baseline StdDevQPS my_modified_version StdDev
Pct diff p-value
OrHighMed 199.09 (3.5%) 105.27 (2.5%)
-47.1% ( -51% - -42%) 0.000
OrHighLow 536.68 (6.0%) 309.93 (3.2%)
-42.3% ( -48% - -35%) 0.000
OrHighHigh 34.53 (2.3%) 23.21 (3.8%)
-32.8% ( -38% - -27%) 0.000
LowTerm 1830.50 (4.8%) 1784.41 (5.1%)
-2.5% ( -11% - 7%) 0.109
HighPhrase 243.73 (2.6%) 237.72 (2.9%)
-2.5% ( -7% - 3%) 0.005
OrNotHighLow 1251.92 (3.8%) 1236.67 (4.1%)
-1.2% ( -8% - 6%) 0.328
OrHighNotMed 760.26 (4.4%) 751.82 (4.7%)
-1.1% ( -9% - 8%) 0.443
HighTerm 1384.99 (4.2%) 1370.00 (4.2%)
-1.1% ( -9% - 7%) 0.415
LowPhrase 80.03 (3.2%) 79.19 (3.5%)
-1.1% ( -7% - 5%) 0.321
LowSpanNear 194.21 (2.3%) 192.63 (2.4%)
-0.8% ( -5% - 4%) 0.281
OrNotHighHigh 687.96 (6.5%) 682.76 (4.9%)
-0.8% ( -11% - 11%) 0.679
MedPhrase 435.41 (3.1%) 432.56 (3.8%)
-0.7% ( -7% - 6%) 0.554
MedSpanNear 143.42 (3.0%) 142.58 (2.8%)
-0.6% ( -6% - 5%) 0.520
HighTermMonthSort 153.33 (13.2%) 152.43 (11.4%)
-0.6% ( -22% - 27%) 0.880
HighSpanNear 46.53 (2.7%) 46.31 (2.4%)
-0.5% ( -5% - 4%) 0.568
PKLookup 222.89 (3.2%) 221.95 (3.3%)
-0.4% ( -6% - 6%) 0.683
TermDTSort 210.61 (15.6%) 209.73 (15.1%)
-0.4% ( -26% - 35%) 0.932
HighTermDayOfYearSort 261.28 (8.7%) 260.58 (8.2%)
-0.3% ( -15% - 18%) 0.921
MedTerm 1647.86 (3.4%) 1644.52 (5.7%)
-0.2% ( -8% - 9%) 0.891
MedSloppyPhrase 30.70 (2.8%) 30.65 (2.4%)
-0.2% ( -5% - 5%) 0.838
BrowseMonthSSDVFacets 31.90 (2.1%) 31.86 (2.2%)
-0.1% ( -4% - 4%) 0.870
BrowseDayOfYearTaxoFacets 11.13 (2.9%) 11.13 (2.7%)
-0.0% ( -5% - 5%) 0.958
LowSloppyPhrase 72.26 (1.9%) 72.26 (1.5%)
-0.0% ( -3% - 3%) 0.985
AndHighLow 1093.17 (4.7%) 1093.14 (5.8%)
-0.0% ( -10% - 11%) 0.999
BrowseMonthTaxoFacets 13.15 (2.4%) 13.15 (2.6%)
0.0% ( -4% - 5%) 0.995
BrowseDateTaxoFacets 11.10 (2.8%) 11.11 (2.6%)
0.0% ( -5% - 5%) 0.956
Prefix3 435.49 (5.6%) 435.75 (4.6%)
0.1% ( -9% - 10%) 0.971
HighTermTitleBDVSort 349.10 (15.4%) 349.53 (15.9%)
0.1% ( -26% - 37%) 0.980
IntNRQ 196.54 (1.2%) 196.83 (1.4%)
0.1% ( -2% - 2%) 0.726
HighIntervalsOrdered 39.29 (1.7%) 39.35 (1.7%)
0.2% ( -3% - 3%) 0.779
Respell 86.26 (2.8%) 86.41 (2.2%)
0.2% ( -4% - 5%) 0.828
OrNotHighMed 630.88 (5.5%) 632.63 (4.2%)
0.3% ( -9% - 10%) 0.859
Wildcard 219.64 (3.3%) 220.47 (3.0%)
0.4% ( -5% - 6%) 0.700
AndHighMed 446.48 (3.2%) 448.84 (2.5%)
0.5% ( -5% - 6%) 0.566
HighSloppyPhrase 48.95 (5.3%) 49.29 (4.3%)
0.7% ( -8% - 10%) 0.653
Fuzzy1 77.46 (5.8%) 78.08 (6.6%)
0.8% ( -10% - 13%) 0.683
OrHighNotHigh 646.82 (5.2%) 653.41 (5.8%)
1.0% ( -9% - 12%) 0.558
BrowseDayOfYearSSDVFacets 27.71 (6.9%) 28.04 (5.3%)
1.2% ( -10% - 14%) 0.543
AndHighHigh 153.06 (3.3%) 155.03 (4.2%)
1.3% ( -6% - 9%) 0.283
OrHighNotLow 783.18 (5.7%) 802.15 (5.5%)
2.4% ( -8% - 14%) 0.173
Fuzzy2 82.84 (18.2%) 86.90 (16.6%)
4.9% ( -25% - 48%) 0.373
```
```
TaskQPS baseline StdDevQPS my_modified_version
StdDev Pct diff p-value
OrHighMed 217.30 (3.7%) 124.89 (1.6%)
-42.5% ( -46% - -38%) 0.000
OrHighHigh 66.63 (2.2%) 49.45 (1.5%)
-25.8% ( -28% - -22%) 0.000
OrHighLow 225.66 (2.9%) 210.48 (4.3%)
-6.7% ( -13% - 0%) 0.000
OrNotHighHigh 828.22 (5.6%) 803.12 (5.7%)
-3.0% ( -13% - 8%) 0.090
OrHighNotHigh 788.67 (5.7%) 766.95 (5.1%)
-2.8% ( -12% - 8%) 0.107
HighTermTitleBDVSort 233.10 (10.2%) 227.07 (8.9%)
-2.6% ( -19% - 18%) 0.393
HighTermMonthSort 399.02 (12.3%) 389.61 (13.3%)
-2.4% ( -24% - 26%) 0.560
MedTerm 1607.99 (7.4%) 1570.56 (3.6%)
-2.3% ( -12% - 9%) 0.206
OrNotHighMed 702.25 (4.6%) 687.85 (5.8%)
-2.1% ( -11% - 8%) 0.213
HighTermDayOfYearSort 258.38 (14.9%) 253.13 (13.3%)
-2.0% ( -26% - 30%) 0.649
Prefix3 499.62 (5.8%) 490.49 (5.9%)
-1.8% ( -12% - 10%) 0.323
LowTerm 1675.66 (4.5%) 1645.62 (4.4%)
-1.8% ( -10% - 7%) 0.203
Wildcard 148.88 (2.8%) 146.54 (3.8%)
-1.6% ( -7% - 5%) 0.138
OrHighNotLow 752.35 (5.4%) 741.10 (7.0%)
-1.5% ( -13% - 11%) 0.446
MedSloppyPhrase 35.95 (3.7%) 35.59 (3.1%)
-1.0% ( -7% - 6%) 0.354
MedPhrase 738.72 (5.1%) 731.71 (5.3%)
-0.9% ( -10% - 9%) 0.564
LowSloppyPhrase 75.04 (3.4%) 74.41 (3.1%)
-0.8% ( -7% - 5%) 0.414
TermDTSort 444.12 (14.6%) 440.54 (14.0%)
-0.8% ( -25% - 32%) 0.858
OrNotHighLow 903.20 (3.9%) 898.10 (4.3%)
-0.6% ( -8% - 7%) 0.662
PKLookup 217.06 (3.8%) 216.21 (3.6%)
-0.4% ( -7% - 7%) 0.739
MedSpanNear 124.58 (3.3%) 124.14 (1.7%)
-0.3% ( -5% - 4%) 0.676
HighPhrase 84.33 (2.9%) 84.05 (3.0%)
-0.3% ( -6% - 5%) 0.718
LowPhrase 37.84 (3.7%) 37.72 (3.7%)
-0.3% ( -7% - 7%) 0.782
Fuzzy2 64.65 (13.7%) 64.47 (11.6%)
-0.3% ( -22% - 29%) 0.943
Fuzzy1 57.26 (8.4%) 57.13 (7.4%)
-0.2% ( -14% - 16%) 0.930
AndHighHigh 126.99 (2.2%) 126.72 (3.0%)
-0.2% ( -5% - 5%) 0.804
HighIntervalsOrdered 13.60 (2.8%) 13.59 (2.5%)
-0.1% ( -5% - 5%) 0.916
Respell 102.67 (2.9%) 102.59 (2.4%)
-0.1% ( -5% - 5%) 0.930
LowSpanNear 63.07 (3.0%) 63.16 (2.3%)
0.2% ( -4% - 5%) 0.857
HighSloppyPhrase 91.17 (3.5%) 91.31 (3.3%)
0.2% ( -6% - 7%) 0.887
AndHighMed 284.25 (2.0%) 285.44 (2.6%)
0.4% ( -4% - 5%) 0.568
HighTerm 1258.74 (4.9%) 1264.45 (3.7%)
0.5% ( -7% - 9%) 0.741
OrHighNotMed 699.99 (6.1%) 703.29 (7.3%)
0.5% ( -12% - 14%) 0.824
BrowseDayOfYearTaxoFacets 10.94 (3.8%) 11.00 (3.5%)
0.5% ( -6% - 8%) 0.653
BrowseMonthTaxoFacets 13.06 (2.4%) 13.13 (2.6%)
0.5% ( -4% - 5%) 0.505
BrowseDateTaxoFacets 10.92 (3.8%) 10.98 (3.6%)
0.6% ( -6% - 8%) 0.625
AndHighLow 1026.60 (4.0%) 1032.70 (4.5%)
0.6% ( -7% - 9%) 0.659
BrowseMonthSSDVFacets 31.41 (5.4%) 31.63 (2.4%)
0.7% ( -6% - 9%) 0.595
IntNRQ 293.66 (3.3%) 295.77 (2.0%)
0.7% ( -4% - 6%) 0.407
HighSpanNear 147.03 (3.1%) 148.42 (1.8%)
0.9% ( -3% - 6%) 0.243
BrowseDayOfYearSSDVFacets 27.66 (5.2%) 28.13 (1.7%)
1.7% ( -4% - 9%) 0.163
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
