zacharymorn commented on PR #1018:
URL: https://github.com/apache/lucene/pull/1018#issuecomment-1186398587
Here are the latest `wikinightly` benchmark results:
```
TaskQPS baseline StdDevQPS
my_modified_version StdDev Pct diff p-value
BrowseDateSSDVFacets 3.98 (34.1%) 3.73
(29.8%) -6.2% ( -52% - 87%) 0.541
OrHighMedDayTaxoFacets 24.64 (5.9%) 23.96
(9.5%) -2.7% ( -17% - 13%) 0.271
TermDTSort 342.77 (7.8%) 336.36
(4.7%) -1.9% ( -13% - 11%) 0.359
BrowseRandomLabelSSDVFacets 20.43 (9.3%) 20.06
(9.4%) -1.8% ( -18% - 18%) 0.539
TermBGroup1M1P 37.19 (7.0%) 36.72
(5.2%) -1.3% ( -12% - 11%) 0.521
AndHighHighDayTaxoFacets 12.29 (3.1%) 12.13
(2.9%) -1.3% ( -7% - 4%) 0.191
MedTermDayTaxoFacets 75.53 (5.2%) 75.06
(5.3%) -0.6% ( -10% - 10%) 0.706
TermMonthSort 351.78 (6.0%) 349.61
(2.6%) -0.6% ( -8% - 8%) 0.675
Fuzzy1 79.12 (2.5%) 78.71
(2.4%) -0.5% ( -5% - 4%) 0.509
IntervalsOrdered 13.21 (3.1%) 13.14
(3.4%) -0.5% ( -6% - 6%) 0.625
TermDateFacets 72.10 (5.6%) 71.78
(5.5%) -0.4% ( -10% - 11%) 0.797
TermTitleSort 350.94 (6.0%) 349.80
(2.8%) -0.3% ( -8% - 8%) 0.826
PKLookup 322.25 (5.8%) 321.46
(4.3%) -0.2% ( -9% - 10%) 0.879
SpanNear 166.41 (3.5%) 166.06
(2.1%) -0.2% ( -5% - 5%) 0.821
SloppyPhrase 4.74 (4.4%) 4.75
(3.7%) 0.1% ( -7% - 8%) 0.942
Term 3394.26 (5.0%) 3398.22
(5.5%) 0.1% ( -9% - 11%) 0.944
AndMedOrHighHigh 70.98 (5.5%) 71.07
(5.5%) 0.1% ( -10% - 11%) 0.945
AndHighMedDayTaxoFacets 121.81 (2.5%) 122.12
(2.3%) 0.3% ( -4% - 5%) 0.737
Phrase 38.19 (2.5%) 38.29
(2.2%) 0.3% ( -4% - 5%) 0.724
AndHighOrMedMed 120.53 (5.4%) 120.92
(5.4%) 0.3% ( -9% - 11%) 0.849
Respell 91.05 (2.9%) 91.55
(2.5%) 0.5% ( -4% - 6%) 0.522
Fuzzy2 120.74 (2.5%) 121.46
(2.5%) 0.6% ( -4% - 5%) 0.453
AndHighHigh 99.32 (3.3%) 100.24
(3.7%) 0.9% ( -5% - 8%) 0.403
IntNRQ 1188.88 (3.2%) 1200.31
(3.4%) 1.0% ( -5% - 7%) 0.361
Wildcard 163.38 (7.0%) 165.12
(4.5%) 1.1% ( -9% - 13%) 0.566
AndHighMed 156.13 (5.2%) 158.09
(5.1%) 1.3% ( -8% - 12%) 0.439
TermDayOfYearSort 140.35 (3.1%) 142.36
(4.7%) 1.4% ( -6% - 9%) 0.255
BrowseDayOfYearSSDVFacets 26.19 (12.8%) 26.60
(11.7%) 1.6% ( -20% - 29%) 0.686
TermGroup100 65.78 (2.5%) 66.85
(3.7%) 1.6% ( -4% - 8%) 0.109
BrowseMonthTaxoFacets 28.68 (34.4%) 29.16
(37.1%) 1.7% ( -52% - 111%) 0.883
Prefix3 85.54 (6.6%) 87.24
(5.6%) 2.0% ( -9% - 15%) 0.301
BrowseDayOfYearTaxoFacets 28.90 (30.4%) 29.64
(33.9%) 2.6% ( -47% - 96%) 0.800
TermGroup10K 40.11 (3.8%) 41.31
(4.0%) 3.0% ( -4% - 11%) 0.017
TermGroup1M 38.63 (3.8%) 39.82
(3.7%) 3.1% ( -4% - 10%) 0.009
TermBGroup1M 46.33 (3.8%) 47.77
(4.5%) 3.1% ( -5% - 11%) 0.019
BrowseDateTaxoFacets 28.50 (30.4%) 29.46
(34.6%) 3.4% ( -47% - 98%) 0.745
BrowseMonthSSDVFacets 28.27 (14.7%) 29.70
(15.4%) 5.0% ( -21% - 41%) 0.292
BrowseRandomLabelTaxoFacets 28.78 (50.1%) 30.70
(52.7%) 6.7% ( -64% - 219%) 0.680
OrHighHigh 25.55 (5.9%) 37.99
(6.8%) 48.7% ( 34% - 65%) 0.000
OrHighMed 92.43 (6.4%) 210.19
(11.3%) 127.4% ( 103% - 155%) 0.000
```
```
TaskQPS baseline StdDevQPS
my_modified_version StdDev Pct diff p-value
BrowseRandomLabelTaxoFacets 31.88 (50.1%) 28.62
(41.9%) -10.3% ( -68% - 163%) 0.482
BrowseDayOfYearTaxoFacets 30.09 (32.8%) 28.05
(29.6%) -6.8% ( -52% - 82%) 0.492
BrowseDateTaxoFacets 29.97 (32.8%) 27.96
(29.6%) -6.7% ( -52% - 82%) 0.498
BrowseMonthSSDVFacets 29.02 (11.0%) 28.18
(11.9%) -2.9% ( -23% - 22%) 0.425
AndMedOrHighHigh 74.76 (5.4%) 73.11
(4.4%) -2.2% ( -11% - 8%) 0.157
AndHighMed 126.28 (3.9%) 124.07
(3.4%) -1.8% ( -8% - 5%) 0.131
PKLookup 335.29 (4.1%) 329.55
(4.7%) -1.7% ( -10% - 7%) 0.220
AndHighOrMedMed 75.76 (5.5%) 74.49
(4.6%) -1.7% ( -11% - 8%) 0.295
AndHighHigh 45.63 (4.0%) 45.00
(3.1%) -1.4% ( -8% - 5%) 0.217
Respell 92.03 (3.5%) 90.91
(3.0%) -1.2% ( -7% - 5%) 0.232
TermDateFacets 74.23 (4.1%) 73.56
(5.0%) -0.9% ( -9% - 8%) 0.533
MedTermDayTaxoFacets 77.51 (4.0%) 76.87
(4.7%) -0.8% ( -9% - 8%) 0.555
Fuzzy2 83.30 (2.2%) 82.66
(1.7%) -0.8% ( -4% - 3%) 0.213
Term 2672.66 (5.2%) 2652.80
(5.4%) -0.7% ( -10% - 10%) 0.658
Fuzzy1 143.05 (2.9%) 142.09
(2.2%) -0.7% ( -5% - 4%) 0.413
TermDayOfYearSort 211.44 (5.9%) 210.04
(5.5%) -0.7% ( -11% - 11%) 0.716
BrowseDayOfYearSSDVFacets 26.79 (12.0%) 26.62
(12.5%) -0.6% ( -22% - 27%) 0.873
TermDTSort 210.96 (6.8%) 209.84
(4.3%) -0.5% ( -10% - 11%) 0.768
IntNRQ 1210.91 (2.1%) 1207.39
(2.2%) -0.3% ( -4% - 4%) 0.666
AndHighHighDayTaxoFacets 13.87 (2.6%) 13.84
(2.9%) -0.2% ( -5% - 5%) 0.792
Wildcard 379.64 (6.2%) 378.85
(5.2%) -0.2% ( -10% - 11%) 0.908
AndHighMedDayTaxoFacets 138.54 (2.7%) 138.34
(2.2%) -0.1% ( -4% - 4%) 0.854
BrowseRandomLabelSSDVFacets 20.50 (7.4%) 20.48
(9.4%) -0.1% ( -15% - 18%) 0.971
TermGroup100 41.71 (3.3%) 41.73
(4.0%) 0.0% ( -7% - 7%) 0.975
TermGroup1M 30.78 (3.0%) 30.80
(3.8%) 0.1% ( -6% - 7%) 0.953
Phrase 39.17 (2.9%) 39.20
(1.9%) 0.1% ( -4% - 4%) 0.929
IntervalsOrdered 13.06 (3.3%) 13.08
(3.3%) 0.1% ( -6% - 6%) 0.915
TermBGroup1M1P 55.47 (7.1%) 55.55
(6.9%) 0.1% ( -12% - 15%) 0.950
SpanNear 16.33 (3.6%) 16.36
(3.3%) 0.2% ( -6% - 7%) 0.843
TermBGroup1M 35.79 (3.4%) 35.88
(4.6%) 0.3% ( -7% - 8%) 0.835
SloppyPhrase 3.07 (5.8%) 3.09
(4.8%) 0.7% ( -9% - 12%) 0.695
TermGroup10K 32.35 (3.1%) 32.57
(3.6%) 0.7% ( -5% - 7%) 0.515
OrHighMedDayTaxoFacets 16.45 (7.0%) 16.57
(9.1%) 0.7% ( -14% - 17%) 0.785
Prefix3 86.68 (8.1%) 87.62
(5.9%) 1.1% ( -11% - 16%) 0.628
TermTitleSort 350.23 (3.8%) 354.44
(4.4%) 1.2% ( -6% - 9%) 0.356
TermMonthSort 146.79 (3.6%) 149.01
(4.5%) 1.5% ( -6% - 9%) 0.238
BrowseMonthTaxoFacets 28.91 (34.8%) 30.32
(35.8%) 4.9% ( -48% - 115%) 0.662
BrowseDateSSDVFacets 3.84 (32.1%) 4.27
(38.8%) 11.1% ( -45% - 120%) 0.326
OrHighHigh 116.26 (4.4%) 151.51
(10.6%) 30.3% ( 14% - 47%) 0.000
OrHighMed 92.59 (5.0%) 198.39
(11.5%) 114.3% ( 93% - 137%) 0.000
```
```
TaskQPS baseline StdDevQPS
my_modified_version StdDev Pct diff p-value
BrowseRandomLabelTaxoFacets 35.97 (44.1%) 34.15
(43.7%) -5.0% ( -64% - 147%) 0.716
BrowseDateTaxoFacets 33.38 (32.4%) 32.02
(31.5%) -4.1% ( -51% - 88%) 0.685
BrowseDayOfYearTaxoFacets 33.52 (32.3%) 32.22
(31.7%) -3.9% ( -51% - 88%) 0.701
AndHighOrMedMed 74.23 (4.4%) 73.29
(5.1%) -1.3% ( -10% - 8%) 0.402
IntervalsOrdered 23.44 (4.3%) 23.15
(4.0%) -1.2% ( -9% - 7%) 0.350
SloppyPhrase 3.12 (4.2%) 3.09
(3.0%) -1.2% ( -8% - 6%) 0.316
BrowseDayOfYearSSDVFacets 26.92 (11.8%) 26.65
(9.8%) -1.0% ( -20% - 23%) 0.769
AndMedOrHighHigh 35.38 (3.0%) 35.14
(3.8%) -0.7% ( -7% - 6%) 0.532
AndHighMedDayTaxoFacets 96.65 (2.1%) 96.07
(2.3%) -0.6% ( -4% - 3%) 0.393
Term 2606.76 (3.4%) 2593.19
(4.1%) -0.5% ( -7% - 7%) 0.663
TermGroup10K 32.13 (2.8%) 32.00
(4.0%) -0.4% ( -7% - 6%) 0.710
Phrase 39.32 (2.2%) 39.17
(2.1%) -0.4% ( -4% - 4%) 0.586
TermBGroup1M 52.51 (3.4%) 52.34
(4.6%) -0.3% ( -8% - 7%) 0.801
IntNRQ 1217.04 (2.8%) 1213.57
(1.6%) -0.3% ( -4% - 4%) 0.698
SpanNear 168.03 (2.9%) 167.70
(2.6%) -0.2% ( -5% - 5%) 0.818
Fuzzy2 101.68 (2.4%) 101.54
(1.9%) -0.1% ( -4% - 4%) 0.848
TermGroup1M 28.02 (3.0%) 27.99
(4.1%) -0.1% ( -6% - 7%) 0.931
Fuzzy1 155.71 (2.9%) 155.60
(2.8%) -0.1% ( -5% - 5%) 0.935
AndHighMed 162.62 (4.8%) 162.69
(4.4%) 0.0% ( -8% - 9%) 0.978
TermDateFacets 57.30 (4.5%) 57.34
(3.7%) 0.1% ( -7% - 8%) 0.964
BrowseMonthTaxoFacets 31.34 (34.7%) 31.36
(34.7%) 0.1% ( -51% - 106%) 0.995
MedTermDayTaxoFacets 76.65 (4.2%) 76.76
(3.4%) 0.2% ( -7% - 8%) 0.897
Respell 96.97 (3.1%) 97.18
(2.5%) 0.2% ( -5% - 6%) 0.809
BrowseRandomLabelSSDVFacets 20.66 (8.9%) 20.70
(6.6%) 0.2% ( -14% - 17%) 0.928
AndHighHighDayTaxoFacets 38.21 (1.6%) 38.30
(1.6%) 0.2% ( -2% - 3%) 0.649
TermGroup100 41.22 (3.0%) 41.38
(4.0%) 0.4% ( -6% - 7%) 0.717
AndHighHigh 44.28 (3.7%) 44.53
(4.2%) 0.6% ( -7% - 8%) 0.655
TermDTSort 205.94 (2.0%) 207.27
(2.8%) 0.6% ( -4% - 5%) 0.407
OrHighMedDayTaxoFacets 17.46 (6.4%) 17.59
(8.2%) 0.7% ( -13% - 16%) 0.752
TermBGroup1M1P 44.35 (6.1%) 44.70
(6.9%) 0.8% ( -11% - 14%) 0.700
TermDayOfYearSort 141.77 (5.8%) 142.91
(6.7%) 0.8% ( -11% - 14%) 0.685
PKLookup 332.31 (2.9%) 335.34
(3.2%) 0.9% ( -5% - 7%) 0.344
Wildcard 372.08 (5.5%) 380.76
(6.0%) 2.3% ( -8% - 14%) 0.198
TermTitleSort 271.30 (4.6%) 278.23
(7.7%) 2.6% ( -9% - 15%) 0.206
TermMonthSort 187.19 (4.8%) 192.13
(7.8%) 2.6% ( -9% - 16%) 0.198
Prefix3 299.92 (8.2%) 308.42
(7.5%) 2.8% ( -11% - 20%) 0.255
BrowseMonthSSDVFacets 28.70 (11.8%) 29.70
(11.8%) 3.5% ( -17% - 30%) 0.351
BrowseDateSSDVFacets 3.75 (27.7%) 4.06
(30.6%) 8.2% ( -39% - 92%) 0.372
OrHighHigh 25.85 (4.7%) 38.22
(7.7%) 47.8% ( 33% - 63%) 0.000
OrHighMed 94.56 (4.7%) 212.52
(8.9%) 124.7% ( 106% - 145%) 0.000
```
```
TaskQPS baseline StdDevQPS
my_modified_version StdDev Pct diff p-value
BrowseRandomLabelTaxoFacets 31.25 (50.1%) 29.56
(46.8%) -5.4% ( -68% - 183%) 0.725
BrowseMonthTaxoFacets 29.33 (36.9%) 27.79
(33.8%) -5.3% ( -55% - 103%) 0.639
BrowseRandomLabelSSDVFacets 20.79 (7.1%) 19.84
(7.1%) -4.6% ( -17% - 10%) 0.043
Prefix3 86.68 (7.4%) 82.99
(9.8%) -4.3% ( -20% - 13%) 0.121
BrowseMonthSSDVFacets 29.56 (11.8%) 28.39
(9.4%) -4.0% ( -22% - 19%) 0.240
OrHighMedDayTaxoFacets 24.99 (5.5%) 24.25
(8.8%) -3.0% ( -16% - 11%) 0.202
BrowseDayOfYearTaxoFacets 29.40 (32.5%) 28.63
(32.7%) -2.6% ( -51% - 92%) 0.800
BrowseDateTaxoFacets 29.33 (32.7%) 28.59
(32.8%) -2.5% ( -51% - 93%) 0.806
AndHighOrMedMed 76.38 (5.3%) 74.46
(5.5%) -2.5% ( -12% - 8%) 0.141
TermBGroup1M1P 37.13 (8.5%) 36.39
(4.9%) -2.0% ( -14% - 12%) 0.360
AndHighMed 170.75 (4.6%) 167.47
(3.9%) -1.9% ( -10% - 6%) 0.157
AndMedOrHighHigh 36.61 (4.6%) 35.96
(3.3%) -1.8% ( -9% - 6%) 0.162
TermDayOfYearSort 344.59 (8.1%) 339.13
(2.6%) -1.6% ( -11% - 9%) 0.405
AndHighHigh 46.17 (4.3%) 45.46
(3.5%) -1.5% ( -8% - 6%) 0.212
SpanNear 13.79 (1.7%) 13.60
(4.4%) -1.4% ( -7% - 4%) 0.192
MedTermDayTaxoFacets 79.56 (5.1%) 78.49
(4.4%) -1.3% ( -10% - 8%) 0.370
TermDateFacets 73.55 (5.3%) 72.59
(4.5%) -1.3% ( -10% - 9%) 0.401
PKLookup 332.29 (3.7%) 328.27
(5.2%) -1.2% ( -9% - 8%) 0.399
Fuzzy1 81.10 (1.5%) 80.21
(2.6%) -1.1% ( -5% - 3%) 0.097
Wildcard 377.60 (6.0%) 374.74
(5.9%) -0.8% ( -11% - 11%) 0.687
TermGroup100 41.50 (4.4%) 41.19
(3.2%) -0.8% ( -8% - 7%) 0.536
TermBGroup1M 29.94 (5.5%) 29.73
(3.0%) -0.7% ( -8% - 8%) 0.620
Fuzzy2 145.36 (1.8%) 144.59
(2.3%) -0.5% ( -4% - 3%) 0.412
AndHighMedDayTaxoFacets 39.44 (2.0%) 39.31
(2.1%) -0.3% ( -4% - 3%) 0.626
Term 3651.07 (3.4%) 3639.90
(3.0%) -0.3% ( -6% - 6%) 0.763
Respell 96.31 (2.4%) 96.05
(3.3%) -0.3% ( -5% - 5%) 0.773
TermGroup10K 40.70 (5.2%) 40.60
(2.8%) -0.2% ( -7% - 8%) 0.854
AndHighHighDayTaxoFacets 54.55 (1.3%) 54.43
(1.4%) -0.2% ( -2% - 2%) 0.581
IntNRQ 266.78 (0.9%) 267.03
(0.5%) 0.1% ( -1% - 1%) 0.694
TermGroup1M 40.32 (5.2%) 40.50
(3.2%) 0.4% ( -7% - 9%) 0.750
Phrase 235.70 (2.1%) 236.75
(2.2%) 0.4% ( -3% - 4%) 0.520
SloppyPhrase 7.35 (3.6%) 7.43
(4.1%) 1.0% ( -6% - 9%) 0.398
IntervalsOrdered 126.38 (8.0%) 127.93
(6.9%) 1.2% ( -12% - 17%) 0.604
TermMonthSort 188.44 (4.8%) 191.57
(6.4%) 1.7% ( -9% - 13%) 0.352
TermTitleSort 355.92 (4.3%) 362.31
(6.1%) 1.8% ( -8% - 12%) 0.283
TermDTSort 180.53 (4.7%) 184.05
(7.7%) 2.0% ( -9% - 15%) 0.332
BrowseDayOfYearSSDVFacets 26.68 (9.3%) 27.74
(12.0%) 4.0% ( -15% - 27%) 0.238
BrowseDateSSDVFacets 4.05 (28.4%) 4.39
(35.0%) 8.3% ( -42% - 100%) 0.410
OrHighHigh 31.32 (4.8%) 48.33
(7.1%) 54.3% ( 40% - 69%) 0.000
OrHighMed 128.39 (4.7%) 239.33
(6.8%) 86.4% ( 71% - 102%) 0.000
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org
