RamakrishnaChilaka commented on PR #15140:
URL: https://github.com/apache/lucene/pull/15140#issuecomment-3249979975
I ran benchmarks with arity=3 and topN=20 on wikibigall on i3.8xlarge
The results show no statistically significant regressions with topN as 20.
```
TaskQPS baseline StdDevQPS
my_modified_version StdDev Pct diff p-value
OrHighNotMed 560.65 (12.3%) 532.49
(10.4%) -5.0% ( -24% - 20%) 0.164
HighTermDayOfYearSort 389.71 (6.1%) 379.50
(4.3%) -2.6% ( -12% - 8%) 0.118
LowSloppyPhrase 31.28 (9.3%) 30.50
(8.8%) -2.5% ( -18% - 17%) 0.380
AndHighHighDayTaxoFacets 12.43 (5.0%) 12.20
(4.6%) -1.8% ( -10% - 8%) 0.225
BrowseDayOfYearSSDVFacets 2.53 (14.2%) 2.49
(12.0%) -1.7% ( -24% - 28%) 0.681
MedTermDayTaxoFacets 16.95 (5.8%) 16.67
(7.4%) -1.6% ( -13% - 12%) 0.436
Fuzzy2 40.90 (8.5%) 40.26
(10.0%) -1.6% ( -18% - 18%) 0.595
MedSpanNear 123.79 (12.1%) 122.08
(13.0%) -1.4% ( -23% - 26%) 0.727
OrHighNotHigh 615.22 (7.2%) 607.15
(6.4%) -1.3% ( -13% - 13%) 0.540
AndHighLow 842.03 (3.1%) 831.74
(3.2%) -1.2% ( -7% - 5%) 0.220
Prefix3 877.74 (2.9%) 867.66
(3.4%) -1.1% ( -7% - 5%) 0.246
HighPhrase 59.19 (4.5%) 58.62
(4.1%) -1.0% ( -9% - 8%) 0.476
LowSpanNear 153.60 (6.1%) 152.29
(6.6%) -0.9% ( -12% - 12%) 0.671
OrHighLow 670.48 (5.0%) 664.93
(4.5%) -0.8% ( -9% - 9%) 0.583
HighTermMonthSort 1357.59 (3.2%) 1350.69
(5.6%) -0.5% ( -9% - 8%) 0.726
BrowseMonthTaxoFacets 2.02 (7.5%) 2.02
(8.4%) -0.1% ( -14% - 17%) 0.964
HighIntervalsOrdered 20.84 (8.3%) 20.83
(8.6%) -0.1% ( -15% - 18%) 0.978
IntNRQ 147.02 (1.6%) 146.94
(1.3%) -0.1% ( -2% - 2%) 0.912
Wildcard 173.40 (2.9%) 173.51
(2.6%) 0.1% ( -5% - 5%) 0.942
BrowseRandomLabelTaxoFacets 1.40 (3.5%) 1.40
(3.3%) 0.3% ( -6% - 7%) 0.803
AndHighMed 310.68 (8.0%) 311.55
(8.2%) 0.3% ( -14% - 17%) 0.912
AndHighMedDayTaxoFacets 24.35 (4.0%) 24.44
(3.2%) 0.4% ( -6% - 7%) 0.737
MedSloppyPhrase 26.19 (2.7%) 26.31
(3.7%) 0.4% ( -5% - 7%) 0.668
HighSpanNear 8.56 (4.7%) 8.61
(4.9%) 0.5% ( -8% - 10%) 0.737
AndHighHigh 141.75 (19.2%) 142.51
(17.5%) 0.5% ( -30% - 46%) 0.927
LowPhrase 204.22 (3.4%) 205.45
(3.5%) 0.6% ( -6% - 7%) 0.583
OrNotHighMed 591.68 (5.7%) 595.28
(6.7%) 0.6% ( -11% - 13%) 0.758
TermDTSort 219.14 (3.9%) 220.82
(5.6%) 0.8% ( -8% - 10%) 0.615
HighSloppyPhrase 21.66 (4.6%) 21.85
(7.2%) 0.9% ( -10% - 13%) 0.638
OrNotHighLow 838.61 (4.7%) 847.01
(4.8%) 1.0% ( -8% - 10%) 0.503
Respell 20.48 (6.6%) 20.69
(5.5%) 1.1% ( -10% - 14%) 0.583
Fuzzy1 45.98 (8.0%) 46.50
(8.0%) 1.1% ( -13% - 18%) 0.653
OrHighHigh 109.85 (20.7%) 111.12
(20.8%) 1.2% ( -33% - 53%) 0.860
BrowseRandomLabelSSDVFacets 1.59 (7.1%) 1.61
(10.4%) 1.3% ( -15% - 20%) 0.653
MedPhrase 421.59 (3.2%) 427.00
(3.2%) 1.3% ( -4% - 7%) 0.204
OrHighMed 316.82 (13.9%) 321.65
(13.6%) 1.5% ( -22% - 33%) 0.726
HighTerm 411.86 (21.1%) 418.48
(20.1%) 1.6% ( -32% - 54%) 0.805
HighTermTitleBDVSort 13.60 (5.3%) 13.84
(5.7%) 1.8% ( -8% - 13%) 0.312
BrowseDateTaxoFacets 1.82 (6.3%) 1.85
(7.3%) 1.8% ( -11% - 16%) 0.408
HighTermTitleSort 102.22 (4.6%) 104.06
(4.9%) 1.8% ( -7% - 11%) 0.232
BrowseDayOfYearTaxoFacets 1.87 (6.8%) 1.90
(8.3%) 1.8% ( -12% - 18%) 0.446
OrNotHighHigh 544.66 (10.8%) 554.63
(12.4%) 1.8% ( -19% - 28%) 0.619
OrHighMedDayTaxoFacets 5.43 (7.4%) 5.53
(7.2%) 1.9% ( -11% - 17%) 0.417
range 3046.35 (8.8%) 3106.25
(8.5%) 2.0% ( -14% - 21%) 0.472
LowTerm 866.65 (31.5%) 884.09
(30.8%) 2.0% ( -45% - 94%) 0.838
PKLookup 133.59 (8.8%) 137.11
(8.0%) 2.6% ( -13% - 21%) 0.321
OrHighNotLow 459.18 (11.2%) 472.18
(9.2%) 2.8% ( -15% - 26%) 0.382
MedIntervalsOrdered 77.62 (9.3%) 80.07
(8.9%) 3.2% ( -13% - 23%) 0.274
BrowseDateSSDVFacets 0.54 (11.9%) 0.56
(10.9%) 3.5% ( -17% - 29%) 0.337
LowIntervalsOrdered 20.99 (6.9%) 21.72
(7.2%) 3.5% ( -9% - 18%) 0.117
MedTerm 394.43 (11.2%) 409.52
(14.7%) 3.8% ( -19% - 33%) 0.356
IntSet 373.81 (8.4%) 388.84
(10.3%) 4.0% ( -13% - 24%) 0.177
BrowseMonthSSDVFacets 2.68 (13.7%) 2.84
(19.3%) 5.8% ( -23% - 45%) 0.272
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
