RamakrishnaChilaka commented on PR #15140:
URL: https://github.com/apache/lucene/pull/15140#issuecomment-3242827010
Ran benchmarks on `c8g.8xlarge` (graviton) instance.
### arity-3
```
TaskQPS baseline StdDevQPS
my_modified_version StdDev Pct diff p-value
BrowseDateTaxoFacets 4.40 (18.9%) 4.06
(14.3%) -7.8% ( -34% - 31%) 0.142
BrowseDayOfYearTaxoFacets 4.39 (18.1%) 4.05
(13.8%) -7.7% ( -33% - 29%) 0.132
BrowseDayOfYearSSDVFacets 5.53 (11.8%) 5.22
(7.7%) -5.7% ( -22% - 15%) 0.070
BrowseRandomLabelTaxoFacets 3.21 (12.0%) 3.05
(8.9%) -5.0% ( -23% - 18%) 0.137
BrowseRandomLabelSSDVFacets 4.27 (11.6%) 4.17
(10.1%) -2.5% ( -21% - 21%) 0.467
HighTermMonthSort 239.78 (5.8%) 237.72
(4.7%) -0.9% ( -10% - 10%) 0.607
HighTermTitleBDVSort 44.65 (1.7%) 44.29
(1.4%) -0.8% ( -3% - 2%) 0.102
PKLookup 248.25 (2.2%) 247.20
(3.2%) -0.4% ( -5% - 5%) 0.623
HighTermTitleSort 87.91 (2.8%) 87.58
(2.8%) -0.4% ( -5% - 5%) 0.670
AndHighLow 1536.38 (3.0%) 1531.14
(2.7%) -0.3% ( -5% - 5%) 0.707
AndHighHighDayTaxoFacets 21.59 (1.9%) 21.54
(1.8%) -0.2% ( -3% - 3%) 0.712
MedIntervalsOrdered 13.44 (9.3%) 13.43
(8.9%) -0.1% ( -16% - 19%) 0.966
Respell 59.42 (1.7%) 59.36
(1.9%) -0.1% ( -3% - 3%) 0.851
AndHighMedDayTaxoFacets 61.90 (0.7%) 61.83
(0.9%) -0.1% ( -1% - 1%) 0.683
range 3970.86 (3.6%) 3981.24
(4.9%) 0.3% ( -7% - 9%) 0.847
BrowseMonthTaxoFacets 3.15 (2.7%) 3.16
(2.9%) 0.4% ( -5% - 6%) 0.653
HighTermDayOfYearSort 142.15 (3.2%) 142.96
(2.5%) 0.6% ( -4% - 6%) 0.525
HighSpanNear 33.18 (3.7%) 33.40
(3.4%) 0.7% ( -6% - 8%) 0.559
TermDTSort 138.58 (2.3%) 139.55
(2.5%) 0.7% ( -3% - 5%) 0.351
LowSpanNear 18.61 (2.3%) 18.74
(2.0%) 0.7% ( -3% - 5%) 0.295
HighIntervalsOrdered 42.55 (7.0%) 42.88
(6.5%) 0.8% ( -11% - 15%) 0.717
LowIntervalsOrdered 52.36 (2.1%) 52.82
(1.8%) 0.9% ( -2% - 4%) 0.158
MedTermDayTaxoFacets 51.42 (2.6%) 51.93
(2.7%) 1.0% ( -4% - 6%) 0.237
MedSpanNear 17.26 (6.6%) 17.43
(5.8%) 1.0% ( -10% - 14%) 0.599
Fuzzy2 80.04 (2.2%) 80.90
(2.2%) 1.1% ( -3% - 5%) 0.116
MedPhrase 58.45 (2.4%) 59.09
(2.0%) 1.1% ( -3% - 5%) 0.113
Wildcard 544.95 (3.4%) 551.96
(3.9%) 1.3% ( -5% - 8%) 0.269
OrHighMedDayTaxoFacets 11.78 (6.3%) 11.94
(5.2%) 1.4% ( -9% - 13%) 0.441
HighSloppyPhrase 47.46 (2.5%) 48.14
(3.6%) 1.4% ( -4% - 7%) 0.141
Fuzzy1 82.67 (2.2%) 83.95
(2.2%) 1.5% ( -2% - 6%) 0.026
LowPhrase 161.42 (1.5%) 163.94
(1.0%) 1.6% ( 0% - 4%) 0.000
IntNRQ 372.37 (1.8%) 380.36
(2.1%) 2.1% ( -1% - 6%) 0.001
LowSloppyPhrase 104.48 (1.9%) 106.80
(1.7%) 2.2% ( -1% - 5%) 0.000
Prefix3 901.22 (5.7%) 925.71
(8.1%) 2.7% ( -10% - 17%) 0.221
BrowseDateSSDVFacets 1.04 (9.7%) 1.07
(9.4%) 2.7% ( -14% - 24%) 0.368
IntSet 779.52 (6.5%) 801.15
(5.1%) 2.8% ( -8% - 15%) 0.133
HighPhrase 99.20 (1.9%) 101.99
(1.5%) 2.8% ( 0% - 6%) 0.000
BrowseMonthSSDVFacets 5.41 (10.8%) 5.63
(14.4%) 4.0% ( -19% - 32%) 0.321
MedSloppyPhrase 218.23 (1.9%) 227.35
(2.3%) 4.2% ( 0% - 8%) 0.000
OrNotHighLow 1100.00 (2.4%) 1161.75
(2.4%) 5.6% ( 0% - 10%) 0.000
AndHighMed 323.81 (3.9%) 343.16
(4.1%) 6.0% ( -1% - 14%) 0.000
OrNotHighHigh 130.10 (9.1%) 138.82
(7.9%) 6.7% ( -9% - 26%) 0.013
AndHighHigh 253.29 (7.9%) 271.17
(7.7%) 7.1% ( -7% - 24%) 0.004
OrNotHighMed 355.85 (4.9%) 387.51
(4.6%) 8.9% ( 0% - 19%) 0.000
OrHighHigh 188.87 (11.7%) 206.67
(11.9%) 9.4% ( -12% - 37%) 0.012
OrHighMed 335.86 (3.2%) 370.68
(4.4%) 10.4% ( 2% - 18%) 0.000
OrHighNotHigh 453.89 (4.7%) 504.08
(5.5%) 11.1% ( 0% - 22%) 0.000
OrHighNotMed 247.33 (10.9%) 276.47
(10.2%) 11.8% ( -8% - 37%) 0.000
OrHighLow 347.23 (10.2%) 395.47
(12.3%) 13.9% ( -7% - 40%) 0.000
OrHighNotLow 345.07 (12.7%) 394.73
(13.4%) 14.4% ( -10% - 46%) 0.000
LowTerm 810.53 (7.3%) 940.58
(9.0%) 16.0% ( 0% - 34%) 0.000
HighTerm 373.56 (11.4%) 434.34
(14.6%) 16.3% ( -8% - 47%) 0.000
MedTerm 457.24 (10.0%) 533.31
(12.9%) 16.6% ( -5% - 43%) 0.000
```
### arity-4
```
TaskQPS baseline StdDevQPS
my_modified_version StdDev Pct diff p-value
AndHighLow 1425.61 (3.2%) 1373.91
(1.9%) -3.6% ( -8% - 1%) 0.000
BrowseDateSSDVFacets 1.03 (9.8%) 1.01
(9.4%) -1.7% ( -19% - 19%) 0.569
range 2741.78 (7.5%) 2695.25
(8.0%) -1.7% ( -15% - 14%) 0.489
BrowseMonthTaxoFacets 3.16 (3.0%) 3.12
(2.3%) -1.3% ( -6% - 4%) 0.111
HighTermDayOfYearSort 131.15 (3.9%) 129.63
(2.5%) -1.2% ( -7% - 5%) 0.266
BrowseRandomLabelSSDVFacets 4.21 (6.7%) 4.17
(5.8%) -1.0% ( -12% - 12%) 0.613
BrowseMonthSSDVFacets 5.60 (9.1%) 5.55
(9.8%) -1.0% ( -18% - 19%) 0.739
TermDTSort 122.31 (3.3%) 121.16
(2.7%) -0.9% ( -6% - 5%) 0.320
AndHighHighDayTaxoFacets 30.80 (1.6%) 30.76
(1.4%) -0.2% ( -3% - 2%) 0.740
HighSloppyPhrase 17.99 (4.5%) 17.99
(3.7%) -0.0% ( -7% - 8%) 0.983
AndHighMedDayTaxoFacets 63.24 (1.2%) 63.27
(1.7%) 0.0% ( -2% - 2%) 0.920
MedTermDayTaxoFacets 28.49 (1.8%) 28.50
(2.5%) 0.1% ( -4% - 4%) 0.933
Respell 55.79 (1.2%) 55.83
(1.2%) 0.1% ( -2% - 2%) 0.858
HighTermTitleBDVSort 35.33 (2.9%) 35.48
(2.7%) 0.4% ( -4% - 6%) 0.630
PKLookup 247.22 (2.6%) 248.30
(2.1%) 0.4% ( -4% - 5%) 0.562
OrHighMedDayTaxoFacets 14.76 (4.5%) 14.85
(4.7%) 0.6% ( -8% - 10%) 0.675
HighIntervalsOrdered 66.21 (8.6%) 66.68
(8.8%) 0.7% ( -15% - 19%) 0.797
LowSloppyPhrase 64.20 (2.5%) 64.68
(2.3%) 0.7% ( -3% - 5%) 0.331
AndHighMed 784.54 (1.7%) 790.69
(2.0%) 0.8% ( -2% - 4%) 0.188
HighSpanNear 65.48 (2.4%) 66.05
(3.3%) 0.9% ( -4% - 6%) 0.337
BrowseDayOfYearSSDVFacets 5.46 (7.0%) 5.51
(10.2%) 0.9% ( -15% - 19%) 0.745
LowIntervalsOrdered 52.44 (3.7%) 52.92
(3.5%) 0.9% ( -6% - 8%) 0.425
MedSpanNear 305.20 (2.4%) 308.38
(3.4%) 1.0% ( -4% - 7%) 0.268
Wildcard 462.71 (2.4%) 467.58
(6.0%) 1.1% ( -7% - 9%) 0.467
HighTermTitleSort 85.75 (2.8%) 86.79
(2.2%) 1.2% ( -3% - 6%) 0.123
MedIntervalsOrdered 82.17 (2.8%) 83.21
(2.8%) 1.3% ( -4% - 7%) 0.158
MedPhrase 207.87 (1.2%) 210.98
(1.4%) 1.5% ( -1% - 4%) 0.000
HighTermMonthSort 219.20 (4.9%) 222.79
(5.4%) 1.6% ( -8% - 12%) 0.317
HighPhrase 56.74 (2.4%) 57.69
(2.7%) 1.7% ( -3% - 6%) 0.036
Fuzzy1 91.76 (2.3%) 93.35
(2.8%) 1.7% ( -3% - 6%) 0.031
MedSloppyPhrase 86.91 (3.8%) 88.52
(2.9%) 1.9% ( -4% - 8%) 0.080
Fuzzy2 77.27 (2.0%) 78.72
(2.3%) 1.9% ( -2% - 6%) 0.006
BrowseRandomLabelTaxoFacets 3.01 (8.3%) 3.09
(13.7%) 2.7% ( -17% - 26%) 0.458
AndHighHigh 173.99 (9.5%) 178.66
(12.1%) 2.7% ( -17% - 26%) 0.436
OrNotHighHigh 163.96 (5.6%) 168.45
(6.6%) 2.7% ( -8% - 15%) 0.158
LowSpanNear 176.24 (1.2%) 181.23
(1.6%) 2.8% ( 0% - 5%) 0.000
BrowseDateTaxoFacets 3.99 (13.8%) 4.11
(18.9%) 2.9% ( -26% - 41%) 0.577
BrowseDayOfYearTaxoFacets 3.99 (13.0%) 4.11
(18.0%) 2.9% ( -24% - 38%) 0.554
IntSet 802.92 (3.9%) 827.71
(2.4%) 3.1% ( -3% - 9%) 0.003
OrNotHighLow 1102.01 (2.2%) 1142.50
(2.1%) 3.7% ( 0% - 8%) 0.000
IntNRQ 653.62 (4.9%) 680.93
(1.9%) 4.2% ( -2% - 11%) 0.000
LowPhrase 207.68 (1.2%) 216.45
(1.7%) 4.2% ( 1% - 7%) 0.000
OrHighHigh 192.14 (7.5%) 201.40
(8.7%) 4.8% ( -10% - 22%) 0.061
Prefix3 936.12 (2.3%) 987.04
(2.2%) 5.4% ( 0% - 10%) 0.000
OrHighNotHigh 200.39 (6.5%) 212.87
(8.5%) 6.2% ( -8% - 22%) 0.009
OrNotHighMed 370.49 (3.1%) 398.45
(3.4%) 7.5% ( 0% - 14%) 0.000
OrHighNotMed 308.07 (7.9%) 337.45
(10.7%) 9.5% ( -8% - 30%) 0.001
OrHighMed 377.59 (4.9%) 413.78
(6.0%) 9.6% ( -1% - 21%) 0.000
OrHighLow 345.74 (7.5%) 378.89
(9.6%) 9.6% ( -7% - 28%) 0.000
HighTerm 302.02 (11.7%) 339.59
(14.8%) 12.4% ( -12% - 44%) 0.003
OrHighNotLow 406.92 (9.0%) 461.10
(13.3%) 13.3% ( -8% - 39%) 0.000
MedTerm 544.38 (7.9%) 628.43
(10.2%) 15.4% ( -2% - 36%) 0.000
LowTerm 794.36 (6.5%) 920.28
(8.8%) 15.9% ( 0% - 33%) 0.000
```
### arity-5
```
TaskQPS baseline StdDevQPS
my_modified_version StdDev Pct diff p-value
BrowseRandomLabelSSDVFacets 4.22 (9.6%) 4.04
(7.0%) -4.3% ( -19% - 13%) 0.104
BrowseMonthSSDVFacets 5.74 (11.5%) 5.50
(10.2%) -4.2% ( -23% - 19%) 0.221
AndHighLow 1336.23 (3.8%) 1284.48
(2.8%) -3.9% ( -10% - 2%) 0.000
HighTermTitleSort 59.92 (3.4%) 58.09
(6.3%) -3.1% ( -12% - 6%) 0.058
BrowseDayOfYearSSDVFacets 5.41 (8.6%) 5.27
(8.3%) -2.6% ( -17% - 15%) 0.321
OrHighMedDayTaxoFacets 2.68 (4.0%) 2.63
(6.3%) -1.8% ( -11% - 8%) 0.270
OrNotHighLow 1288.10 (2.7%) 1265.76
(2.6%) -1.7% ( -6% - 3%) 0.038
TermDTSort 121.99 (1.8%) 119.99
(3.3%) -1.6% ( -6% - 3%) 0.048
BrowseMonthTaxoFacets 3.18 (2.8%) 3.14
(2.5%) -1.5% ( -6% - 4%) 0.087
MedTermDayTaxoFacets 28.05 (2.2%) 27.73
(3.3%) -1.1% ( -6% - 4%) 0.202
IntNRQ 275.70 (2.3%) 272.63
(2.0%) -1.1% ( -5% - 3%) 0.095
HighTermMonthSort 241.38 (5.2%) 238.72
(4.0%) -1.1% ( -9% - 8%) 0.447
HighTermDayOfYearSort 135.52 (2.2%) 134.27
(2.6%) -0.9% ( -5% - 4%) 0.236
HighIntervalsOrdered 6.99 (4.7%) 6.93
(5.2%) -0.8% ( -10% - 9%) 0.609
HighTermTitleBDVSort 37.60 (1.7%) 37.35
(2.4%) -0.7% ( -4% - 3%) 0.320
AndHighMedDayTaxoFacets 56.27 (1.2%) 56.04
(1.1%) -0.4% ( -2% - 1%) 0.271
HighPhrase 17.65 (2.3%) 17.60
(2.3%) -0.3% ( -4% - 4%) 0.691
Respell 54.37 (2.3%) 54.26
(2.1%) -0.2% ( -4% - 4%) 0.768
HighSloppyPhrase 18.43 (2.1%) 18.41
(2.3%) -0.1% ( -4% - 4%) 0.856
LowSloppyPhrase 75.28 (1.5%) 75.18
(3.1%) -0.1% ( -4% - 4%) 0.872
AndHighHighDayTaxoFacets 53.16 (0.9%) 53.10
(0.8%) -0.1% ( -1% - 1%) 0.677
PKLookup 243.00 (2.2%) 243.25
(2.2%) 0.1% ( -4% - 4%) 0.886
LowPhrase 24.08 (1.9%) 24.11
(2.0%) 0.1% ( -3% - 4%) 0.854
MedSloppyPhrase 27.86 (1.7%) 27.90
(1.9%) 0.1% ( -3% - 3%) 0.818
Wildcard 383.59 (4.5%) 384.41
(3.3%) 0.2% ( -7% - 8%) 0.863
HighSpanNear 34.11 (2.5%) 34.20
(2.7%) 0.3% ( -4% - 5%) 0.754
range 2658.46 (5.9%) 2665.62
(4.1%) 0.3% ( -9% - 10%) 0.867
Fuzzy1 100.42 (3.9%) 100.77
(2.9%) 0.3% ( -6% - 7%) 0.752
MedIntervalsOrdered 59.23 (1.5%) 59.68
(1.6%) 0.8% ( -2% - 3%) 0.123
Fuzzy2 80.09 (2.9%) 80.83
(3.3%) 0.9% ( -5% - 7%) 0.349
BrowseRandomLabelTaxoFacets 2.84 (5.7%) 2.88
(7.5%) 1.5% ( -11% - 15%) 0.488
MedPhrase 130.23 (1.1%) 132.72
(2.9%) 1.9% ( -2% - 6%) 0.006
IntSet 723.72 (3.3%) 737.90
(3.4%) 2.0% ( -4% - 9%) 0.067
Prefix3 608.92 (4.4%) 621.60
(2.4%) 2.1% ( -4% - 9%) 0.062
MedSpanNear 115.65 (3.1%) 118.46
(2.9%) 2.4% ( -3% - 8%) 0.010
BrowseDateSSDVFacets 1.02 (9.6%) 1.04
(10.1%) 2.5% ( -15% - 24%) 0.418
LowIntervalsOrdered 273.75 (5.4%) 281.51
(6.1%) 2.8% ( -8% - 15%) 0.120
LowSpanNear 322.13 (1.5%) 331.48
(1.7%) 2.9% ( 0% - 6%) 0.000
AndHighMed 497.46 (1.7%) 516.31
(2.7%) 3.8% ( 0% - 8%) 0.000
OrNotHighHigh 121.00 (7.7%) 125.67
(7.7%) 3.9% ( -10% - 20%) 0.115
BrowseDayOfYearTaxoFacets 3.87 (9.0%) 4.07
(15.1%) 5.0% ( -17% - 32%) 0.203
OrHighNotHigh 195.50 (7.4%) 205.34
(8.1%) 5.0% ( -9% - 22%) 0.039
BrowseDateTaxoFacets 3.87 (9.2%) 4.06
(15.9%) 5.1% ( -18% - 33%) 0.209
OrNotHighMed 313.91 (5.4%) 332.61
(5.9%) 6.0% ( -5% - 18%) 0.001
AndHighHigh 204.74 (8.8%) 217.01
(8.1%) 6.0% ( -10% - 25%) 0.025
OrHighHigh 190.70 (8.5%) 202.31
(8.2%) 6.1% ( -9% - 24%) 0.021
OrHighNotMed 296.82 (9.6%) 320.08
(10.2%) 7.8% ( -10% - 30%) 0.012
OrHighNotLow 349.04 (11.9%) 378.12
(12.9%) 8.3% ( -14% - 37%) 0.034
OrHighMed 368.13 (4.7%) 399.89
(3.4%) 8.6% ( 0% - 17%) 0.000
HighTerm 381.10 (11.0%) 418.78
(11.7%) 9.9% ( -11% - 36%) 0.006
OrHighLow 368.70 (7.5%) 406.87
(7.5%) 10.4% ( -4% - 27%) 0.000
MedTerm 531.50 (7.8%) 590.03
(8.4%) 11.0% ( -4% - 29%) 0.000
LowTerm 760.84 (6.5%) 849.10
(7.6%) 11.6% ( -2% - 27%) 0.000
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
