iverase commented on PR #12625:
URL: https://github.com/apache/lucene/pull/12625#issuecomment-1754688030
I run wikimediumall and still a bit noisy:
```
TaskQPS baseline StdDevQPS
my_modified_version StdDev Pct diff p-value
BrowseRandomLabelSSDVFacets 5.34 (9.9%) 5.08
(9.5%) -4.9% ( -22% - 16%) 0.112
BrowseMonthSSDVFacets 6.25 (10.3%) 5.98
(11.2%) -4.3% ( -23% - 19%) 0.201
IntNRQ 74.13 (15.2%) 70.96
(16.8%) -4.3% ( -31% - 32%) 0.398
BrowseDayOfYearSSDVFacets 6.24 (10.0%) 5.98
(10.9%) -4.2% ( -22% - 18%) 0.208
TermDTSort 192.52 (5.3%) 186.26
(7.6%) -3.3% ( -15% - 10%) 0.118
HighTermTitleBDVSort 7.68 (7.3%) 7.43
(7.5%) -3.2% ( -16% - 12%) 0.168
BrowseDateSSDVFacets 1.45 (11.8%) 1.40
(16.2%) -3.1% ( -27% - 28%) 0.482
HighIntervalsOrdered 4.65 (18.0%) 4.51
(15.4%) -3.1% ( -30% - 36%) 0.555
OrHighHigh 35.11 (9.2%) 34.06
(10.6%) -3.0% ( -20% - 18%) 0.340
Prefix3 339.69 (4.8%) 329.55
(9.2%) -3.0% ( -16% - 11%) 0.198
OrHighLow 549.00 (5.6%) 532.81
(6.7%) -2.9% ( -14% - 9%) 0.131
MedSloppyPhrase 19.19 (6.3%) 18.67
(9.4%) -2.7% ( -17% - 13%) 0.283
MedIntervalsOrdered 34.54 (17.0%) 33.61
(15.1%) -2.7% ( -29% - 35%) 0.596
OrHighMed 251.55 (7.5%) 244.84
(9.1%) -2.7% ( -17% - 15%) 0.312
OrNotHighHigh 362.40 (3.0%) 353.04
(7.9%) -2.6% ( -13% - 8%) 0.173
OrNotHighMed 497.20 (3.4%) 484.74
(6.8%) -2.5% ( -12% - 7%) 0.140
AndHighLow 852.22 (3.3%) 831.23
(7.3%) -2.5% ( -12% - 8%) 0.170
HighTermDayOfYearSort 283.45 (2.9%) 276.71
(7.5%) -2.4% ( -12% - 8%) 0.188
OrHighNotLow 513.51 (4.1%) 501.37
(7.7%) -2.4% ( -13% - 9%) 0.226
AndHighMed 68.50 (3.0%) 66.90
(7.5%) -2.3% ( -12% - 8%) 0.192
LowSloppyPhrase 25.08 (4.0%) 24.50
(8.4%) -2.3% ( -14% - 10%) 0.263
OrHighNotHigh 332.84 (3.2%) 325.15
(7.5%) -2.3% ( -12% - 8%) 0.207
LowIntervalsOrdered 3.87 (13.4%) 3.78
(12.6%) -2.2% ( -24% - 27%) 0.588
OrHighNotMed 429.43 (4.2%) 420.06
(8.2%) -2.2% ( -13% - 10%) 0.289
OrNotHighLow 596.57 (2.5%) 583.76
(6.5%) -2.1% ( -10% - 6%) 0.167
HighTermTitleSort 143.63 (2.2%) 140.62
(6.9%) -2.1% ( -10% - 7%) 0.194
AndHighHigh 32.01 (2.6%) 31.34
(7.3%) -2.1% ( -11% - 8%) 0.228
LowPhrase 38.27 (1.7%) 37.51
(7.5%) -2.0% ( -11% - 7%) 0.245
MedPhrase 167.44 (2.2%) 164.14
(8.0%) -2.0% ( -11% - 8%) 0.288
LowTerm 770.36 (4.6%) 755.91
(6.1%) -1.9% ( -12% - 9%) 0.274
MedTermDayTaxoFacets 18.15 (2.8%) 17.81
(6.8%) -1.9% ( -11% - 7%) 0.258
HighSloppyPhrase 6.57 (3.4%) 6.45
(8.0%) -1.8% ( -12% - 9%) 0.354
LowSpanNear 86.59 (1.8%) 85.10
(6.8%) -1.7% ( -10% - 6%) 0.272
HighPhrase 184.92 (2.1%) 181.75
(6.9%) -1.7% ( -10% - 7%) 0.288
AndHighMedDayTaxoFacets 46.77 (2.5%) 45.97
(7.6%) -1.7% ( -11% - 8%) 0.338
HighSpanNear 6.19 (1.6%) 6.09
(7.0%) -1.7% ( -10% - 7%) 0.301
Respell 76.88 (1.4%) 75.61
(7.3%) -1.7% ( -10% - 7%) 0.321
MedSpanNear 33.16 (1.9%) 32.64
(7.0%) -1.6% ( -10% - 7%) 0.335
Fuzzy2 30.94 (1.8%) 30.48
(6.9%) -1.5% ( -10% - 7%) 0.344
MedTerm 788.96 (4.4%) 777.38
(8.7%) -1.5% ( -13% - 12%) 0.500
Fuzzy1 72.99 (1.9%) 71.92
(5.9%) -1.5% ( -9% - 6%) 0.293
AndHighHighDayTaxoFacets 12.31 (1.8%) 12.14
(7.6%) -1.4% ( -10% - 8%) 0.413
HighTermMonthSort 4103.69 (4.1%) 4050.87
(6.7%) -1.3% ( -11% - 9%) 0.462
PKLookup 276.09 (2.2%) 272.79
(6.5%) -1.2% ( -9% - 7%) 0.439
HighTerm 802.38 (3.4%) 796.62
(7.0%) -0.7% ( -10% - 9%) 0.678
Wildcard 70.43 (3.9%) 70.02
(8.7%) -0.6% ( -12% - 12%) 0.784
OrHighMedDayTaxoFacets 2.99 (8.1%) 3.01
(8.9%) 0.5% ( -15% - 18%) 0.857
BrowseRandomLabelTaxoFacets 6.11 (4.5%) 6.16
(8.3%) 0.8% ( -11% - 14%) 0.715
BrowseDateTaxoFacets 6.80 (5.0%) 6.85
(8.7%) 0.8% ( -12% - 15%) 0.720
BrowseDayOfYearTaxoFacets 6.84 (5.2%) 6.90
(9.1%) 0.8% ( -12% - 15%) 0.729
BrowseMonthTaxoFacets 9.65 (31.4%) 10.50
(28.6%) 8.7% ( -39% - 100%) 0.358
```
There has been some changes that might affect lucene bench so I will wait
until waters are calmer to push this change and monitor the benches.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org
