RamakrishnaChilaka commented on PR #15140:
URL: https://github.com/apache/lucene/pull/15140#issuecomment-3239625721
I ran additional benchmarks for arity=4 and arity=5 on an i3.8xlarge EC2
instance with `wikibigall` with topN as 1000.
```
TaskQPS baseline StdDevQPS
my_modified_version StdDev Pct diff p-value
BrowseMonthTaxoFacets 2.11 (15.6%) 1.97
(8.6%) -6.8% ( -26% - 20%) 0.090
AndHighLow 702.46 (4.8%) 679.44
(4.3%) -3.3% ( -11% - 6%) 0.023
range 2588.42 (4.5%) 2510.42
(5.1%) -3.0% ( -12% - 6%) 0.048
PKLookup 134.01 (9.4%) 130.17
(9.8%) -2.9% ( -20% - 18%) 0.346
BrowseMonthSSDVFacets 2.73 (14.2%) 2.68
(14.1%) -1.9% ( -26% - 30%) 0.665
Fuzzy1 34.06 (4.1%) 33.45
(6.6%) -1.8% ( -11% - 9%) 0.300
HighIntervalsOrdered 11.29 (7.5%) 11.09
(6.9%) -1.8% ( -15% - 13%) 0.438
MedTermDayTaxoFacets 22.42 (3.6%) 22.03
(3.9%) -1.8% ( -8% - 5%) 0.139
OrHighMedDayTaxoFacets 7.03 (3.6%) 6.93
(4.0%) -1.5% ( -8% - 6%) 0.205
HighSloppyPhrase 11.25 (10.0%) 11.09
(12.5%) -1.4% ( -21% - 23%) 0.703
BrowseDayOfYearSSDVFacets 2.54 (7.4%) 2.50
(9.1%) -1.3% ( -16% - 16%) 0.618
BrowseRandomLabelSSDVFacets 1.62 (5.6%) 1.60
(6.4%) -0.9% ( -12% - 11%) 0.642
BrowseRandomLabelTaxoFacets 1.38 (3.6%) 1.37
(2.1%) -0.8% ( -6% - 5%) 0.383
MedPhrase 27.46 (5.7%) 27.28
(6.3%) -0.7% ( -11% - 12%) 0.727
LowIntervalsOrdered 114.31 (10.3%) 113.73
(10.1%) -0.5% ( -19% - 22%) 0.875
TermDTSort 49.04 (5.9%) 49.00
(4.6%) -0.1% ( -10% - 11%) 0.969
HighTermTitleSort 15.19 (2.3%) 15.21
(2.1%) 0.1% ( -4% - 4%) 0.853
HighTermTitleBDVSort 19.89 (4.0%) 19.92
(2.1%) 0.2% ( -5% - 6%) 0.877
Respell 18.67 (6.9%) 18.70
(6.9%) 0.2% ( -12% - 15%) 0.928
AndHighMedDayTaxoFacets 16.22 (2.9%) 16.26
(4.2%) 0.3% ( -6% - 7%) 0.804
MedSpanNear 14.25 (3.4%) 14.30
(3.6%) 0.4% ( -6% - 7%) 0.750
HighSpanNear 18.10 (5.6%) 18.17
(5.6%) 0.4% ( -10% - 12%) 0.822
AndHighHighDayTaxoFacets 26.22 (3.2%) 26.38
(3.5%) 0.6% ( -5% - 7%) 0.560
BrowseDateTaxoFacets 1.82 (9.3%) 1.84
(9.1%) 0.6% ( -16% - 21%) 0.830
HighPhrase 24.78 (5.0%) 24.99
(5.5%) 0.8% ( -9% - 11%) 0.621
OrHighHigh 54.07 (13.2%) 54.57
(14.9%) 0.9% ( -23% - 33%) 0.834
MedSloppyPhrase 40.49 (11.4%) 40.95
(8.0%) 1.1% ( -16% - 23%) 0.716
BrowseDayOfYearTaxoFacets 1.87 (8.9%) 1.90
(8.6%) 1.6% ( -14% - 20%) 0.563
HighTermDayOfYearSort 49.93 (4.7%) 50.76
(5.4%) 1.7% ( -8% - 12%) 0.298
LowSloppyPhrase 33.61 (4.2%) 34.34
(3.6%) 2.2% ( -5% - 10%) 0.076
IntSet 342.14 (5.0%) 350.17
(8.2%) 2.3% ( -10% - 16%) 0.274
Fuzzy2 38.24 (7.0%) 39.16
(8.8%) 2.4% ( -12% - 19%) 0.338
LowPhrase 81.34 (5.1%) 83.44
(6.7%) 2.6% ( -8% - 15%) 0.167
HighTermMonthSort 124.62 (10.0%) 128.55
(8.6%) 3.2% ( -14% - 24%) 0.286
OrNotHighHigh 126.56 (9.3%) 131.11
(7.3%) 3.6% ( -11% - 22%) 0.173
AndHighHigh 110.96 (9.5%) 115.01
(10.4%) 3.7% ( -14% - 26%) 0.246
MedIntervalsOrdered 36.48 (11.4%) 37.82
(10.3%) 3.7% ( -16% - 28%) 0.284
AndHighMed 331.48 (4.2%) 346.49
(3.3%) 4.5% ( -2% - 12%) 0.000
OrHighNotHigh 65.15 (10.0%) 68.40
(10.8%) 5.0% ( -14% - 28%) 0.130
OrHighNotMed 104.28 (11.8%) 109.63
(12.0%) 5.1% ( -16% - 32%) 0.173
OrNotHighMed 111.32 (8.0%) 117.42
(7.1%) 5.5% ( -8% - 22%) 0.021
OrHighLow 133.57 (11.5%) 141.84
(12.3%) 6.2% ( -15% - 33%) 0.099
LowSpanNear 116.39 (5.8%) 123.65
(9.6%) 6.2% ( -8% - 22%) 0.013
IntNRQ 401.26 (3.3%) 434.67
(4.3%) 8.3% ( 0% - 16%) 0.000
BrowseDateSSDVFacets 0.51 (11.3%) 0.55
(11.8%) 8.5% ( -13% - 35%) 0.021
OrHighNotLow 184.23 (12.8%) 200.08
(15.6%) 8.6% ( -17% - 42%) 0.057
OrHighMed 154.37 (6.9%) 167.71
(8.8%) 8.6% ( -6% - 26%) 0.001
HighTerm 193.83 (13.1%) 211.10
(18.2%) 8.9% ( -19% - 46%) 0.075
Wildcard 344.97 (6.0%) 376.99
(5.9%) 9.3% ( -2% - 22%) 0.000
OrNotHighLow 523.48 (5.6%) 572.78
(4.7%) 9.4% ( 0% - 20%) 0.000
MedTerm 272.87 (12.8%) 303.38
(14.8%) 11.2% ( -14% - 44%) 0.011
Prefix3 346.15 (5.1%) 388.11
(7.0%) 12.1% ( 0% - 25%) 0.000
LowTerm 424.14 (11.2%) 489.13
(17.5%) 15.3% ( -12% - 49%) 0.001
```
for n-ary 5
```
TaskQPS baseline StdDevQPS
my_modified_version StdDev Pct diff p-value
OrHighMedDayTaxoFacets 7.52 (6.1%) 7.22
(6.2%) -3.9% ( -15% - 8%) 0.044
AndHighLow 918.22 (4.1%) 893.49
(3.3%) -2.7% ( -9% - 4%) 0.022
PKLookup 131.07 (8.9%) 128.88
(13.7%) -1.7% ( -22% - 22%) 0.647
BrowseRandomLabelSSDVFacets 1.54 (8.9%) 1.51
(4.8%) -1.6% ( -13% - 13%) 0.479
HighTermDayOfYearSort 52.05 (5.2%) 51.47
(4.9%) -1.1% ( -10% - 9%) 0.489
AndHighMedDayTaxoFacets 71.07 (4.5%) 70.32
(6.2%) -1.1% ( -11% - 10%) 0.535
LowSpanNear 23.05 (8.5%) 22.83
(7.8%) -1.0% ( -15% - 16%) 0.703
BrowseMonthTaxoFacets 1.96 (5.9%) 1.94
(8.1%) -1.0% ( -14% - 13%) 0.664
AndHighHighDayTaxoFacets 21.41 (4.8%) 21.21
(4.4%) -1.0% ( -9% - 8%) 0.505
HighTermTitleSort 21.28 (4.0%) 21.10
(3.7%) -0.8% ( -8% - 7%) 0.507
Fuzzy1 45.08 (5.8%) 44.73
(8.4%) -0.8% ( -14% - 14%) 0.731
MedTermDayTaxoFacets 22.36 (5.2%) 22.23
(5.3%) -0.6% ( -10% - 10%) 0.719
MedSloppyPhrase 18.25 (5.0%) 18.26
(6.0%) 0.0% ( -10% - 11%) 0.980
HighSloppyPhrase 13.64 (6.5%) 13.72
(4.4%) 0.6% ( -9% - 12%) 0.737
LowSloppyPhrase 27.60 (6.7%) 27.78
(4.3%) 0.6% ( -9% - 12%) 0.713
BrowseDayOfYearTaxoFacets 1.87 (8.5%) 1.88
(19.0%) 0.7% ( -24% - 30%) 0.886
MedSpanNear 14.28 (5.0%) 14.39
(4.4%) 0.7% ( -8% - 10%) 0.617
TermDTSort 51.11 (6.1%) 51.50
(7.6%) 0.8% ( -12% - 15%) 0.729
HighIntervalsOrdered 10.27 (8.8%) 10.35
(9.4%) 0.8% ( -15% - 20%) 0.784
LowIntervalsOrdered 43.86 (3.3%) 44.23
(3.4%) 0.9% ( -5% - 7%) 0.419
MedPhrase 67.55 (4.1%) 68.30
(4.5%) 1.1% ( -7% - 10%) 0.413
HighSpanNear 12.38 (2.4%) 12.53
(3.6%) 1.2% ( -4% - 7%) 0.214
BrowseRandomLabelTaxoFacets 1.35 (3.6%) 1.37
(11.8%) 1.2% ( -13% - 17%) 0.652
BrowseDateTaxoFacets 1.81 (9.8%) 1.84
(18.4%) 1.5% ( -24% - 32%) 0.742
HighTermMonthSort 128.37 (11.1%) 130.37
(10.6%) 1.6% ( -18% - 26%) 0.650
MedIntervalsOrdered 38.78 (10.2%) 39.43
(8.3%) 1.7% ( -15% - 22%) 0.564
Fuzzy2 35.57 (7.0%) 36.22
(8.7%) 1.8% ( -12% - 18%) 0.462
range 2331.03 (7.0%) 2380.31
(6.2%) 2.1% ( -10% - 16%) 0.312
HighPhrase 26.01 (2.2%) 26.60
(2.5%) 2.3% ( -2% - 7%) 0.002
OrNotHighHigh 69.94 (9.9%) 71.71
(10.4%) 2.5% ( -16% - 25%) 0.433
IntNRQ 251.37 (2.3%) 258.93
(2.7%) 3.0% ( -2% - 8%) 0.000
OrHighNotHigh 86.47 (8.6%) 89.21
(9.6%) 3.2% ( -13% - 23%) 0.271
LowPhrase 118.43 (3.0%) 122.61
(3.6%) 3.5% ( -3% - 10%) 0.001
HighTermTitleBDVSort 7.52 (5.2%) 7.80
(5.8%) 3.7% ( -6% - 15%) 0.032
AndHighHigh 56.42 (9.7%) 58.54
(11.8%) 3.8% ( -16% - 27%) 0.272
BrowseMonthSSDVFacets 2.59 (13.1%) 2.69
(23.1%) 3.8% ( -28% - 45%) 0.525
BrowseDateSSDVFacets 0.52 (11.1%) 0.55
(10.5%) 4.4% ( -15% - 29%) 0.194
Respell 27.39 (8.8%) 28.64
(7.3%) 4.5% ( -10% - 22%) 0.075
AndHighMed 157.72 (6.9%) 165.18
(7.4%) 4.7% ( -8% - 20%) 0.036
OrHighHigh 59.00 (8.6%) 61.81
(7.1%) 4.8% ( -10% - 22%) 0.056
OrNotHighLow 509.65 (4.5%) 534.12
(6.1%) 4.8% ( -5% - 16%) 0.005
BrowseDayOfYearSSDVFacets 2.51 (15.6%) 2.64
(20.1%) 5.2% ( -26% - 48%) 0.357
IntSet 350.80 (8.0%) 373.67
(6.4%) 6.5% ( -7% - 22%) 0.004
Wildcard 215.02 (4.5%) 230.84
(5.6%) 7.4% ( -2% - 18%) 0.000
OrHighMed 133.16 (5.9%) 144.00
(4.2%) 8.1% ( -1% - 19%) 0.000
OrHighLow 141.79 (8.9%) 153.40
(11.2%) 8.2% ( -10% - 31%) 0.010
OrNotHighMed 186.12 (4.9%) 201.54
(6.1%) 8.3% ( -2% - 20%) 0.000
OrHighNotMed 139.20 (8.5%) 150.98
(11.5%) 8.5% ( -10% - 31%) 0.008
OrHighNotLow 163.68 (8.6%) 181.52
(10.7%) 10.9% ( -7% - 33%) 0.000
Prefix3 409.57 (6.0%) 461.76
(7.9%) 12.7% ( -1% - 28%) 0.000
HighTerm 210.94 (9.6%) 242.76
(10.5%) 15.1% ( -4% - 38%) 0.000
MedTerm 258.25 (7.6%) 305.79
(8.9%) 18.4% ( 1% - 37%) 0.000
LowTerm 420.58 (9.4%) 510.49
(10.7%) 21.4% ( 1% - 45%) 0.000
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
