txwei commented on PR #16222:
URL: https://github.com/apache/lucene/pull/16222#issuecomment-4662209067
The previous benchmark had some noisy results at the top so I triggered a
rerun:
```
TaskQPS baseline StdDevQPS
my_modified_version StdDev Pct diff p-value
BrowseDateSSDVFacets 4.84 (17.9%) 4.52
(16.5%) -6.5% ( -34% - 34%) 0.235
BrowseRandomLabelTaxoFacets 40.56 (43.7%) 38.12
(41.9%) -6.0% ( -63% - 141%) 0.657
MedIntervalsOrdered 205.10 (3.9%) 199.25
(5.2%) -2.9% ( -11% - 6%) 0.050
range 4482.84 (6.2%) 4388.88
(4.8%) -2.1% ( -12% - 9%) 0.230
BrowseDayOfYearTaxoFacets 36.61 (28.2%) 35.94
(27.8%) -1.8% ( -45% - 75%) 0.837
BrowseDateTaxoFacets 36.24 (28.1%) 35.61
(27.7%) -1.7% ( -44% - 75%) 0.843
AndHighLow 2097.39 (6.9%) 2061.94
(6.5%) -1.7% ( -14% - 12%) 0.428
AndMissingHigh 4808.66 (7.1%) 4751.60
(6.4%) -1.2% ( -13% - 13%) 0.579
BrowseRandomLabelSSDVFacets 19.95 (7.0%) 19.73
(6.7%) -1.1% ( -13% - 13%) 0.609
Fuzzy2 65.16 (3.7%) 64.47
(2.9%) -1.1% ( -7% - 5%) 0.318
MedPhrase 256.31 (7.6%) 253.64
(7.3%) -1.0% ( -14% - 15%) 0.658
HighTermTitleSort 224.13 (5.6%) 221.83
(4.9%) -1.0% ( -10% - 10%) 0.538
Respell 81.82 (2.3%) 81.02
(2.8%) -1.0% ( -5% - 4%) 0.230
HighIntervalsOrdered 56.31 (9.1%) 55.79
(8.5%) -0.9% ( -17% - 18%) 0.737
OrHighMed 1340.31 (6.8%) 1329.63
(6.3%) -0.8% ( -12% - 13%) 0.700
LowIntervalsOrdered 677.30 (7.9%) 673.19
(5.6%) -0.6% ( -13% - 13%) 0.779
MedSloppyPhrase 81.67 (4.7%) 81.21
(5.3%) -0.6% ( -10% - 9%) 0.727
OrHighHigh 521.24 (10.1%) 518.62
(8.5%) -0.5% ( -17% - 20%) 0.864
PKLookup 532.30 (3.6%) 532.08
(3.4%) -0.0% ( -6% - 7%) 0.969
Fuzzy1 134.59 (3.2%) 134.71
(4.3%) 0.1% ( -7% - 7%) 0.941
BrowseMonthSSDVFacets 26.05 (6.1%) 26.07
(6.8%) 0.1% ( -11% - 13%) 0.959
Prefix3 1864.53 (7.4%) 1868.59
(7.3%) 0.2% ( -13% - 16%) 0.925
TermDTSort 466.25 (6.2%) 468.47
(4.4%) 0.5% ( -9% - 11%) 0.780
OrHighNotLow 1955.13 (11.6%) 1967.90
(9.1%) 0.7% ( -17% - 24%) 0.843
MedSpanNear 407.84 (3.8%) 411.11
(3.2%) 0.8% ( -5% - 8%) 0.469
MedTerm 2338.05 (12.4%) 2356.97
(11.9%) 0.8% ( -20% - 28%) 0.833
HighTermMonthSort 2017.21 (7.6%) 2034.73
(6.8%) 0.9% ( -12% - 16%) 0.703
LowPhrase 1074.61 (5.6%) 1086.13
(4.8%) 1.1% ( -8% - 12%) 0.517
AndHighMed 1069.94 (7.9%) 1081.58
(6.1%) 1.1% ( -11% - 16%) 0.625
HighTermTitleBDVSort 125.47 (4.0%) 126.93
(6.2%) 1.2% ( -8% - 11%) 0.482
OrHighMedDayTaxoFacets 32.50 (4.3%) 32.89
(4.5%) 1.2% ( -7% - 10%) 0.387
AndHighHighDayTaxoFacets 51.08 (3.3%) 51.71
(3.7%) 1.2% ( -5% - 8%) 0.273
AndHighHigh 510.55 (11.5%) 517.19
(10.1%) 1.3% ( -18% - 25%) 0.705
OrHighNotMed 1033.25 (9.2%) 1046.97
(9.3%) 1.3% ( -15% - 21%) 0.650
AndHighMedDayTaxoFacets 415.11 (5.0%) 421.46
(6.4%) 1.5% ( -9% - 13%) 0.399
IntNRQ 671.54 (5.2%) 682.36
(3.2%) 1.6% ( -6% - 10%) 0.240
MedTermDayTaxoFacets 155.73 (3.4%) 158.34
(2.4%) 1.7% ( -3% - 7%) 0.071
HighSpanNear 68.17 (5.1%) 69.34
(6.8%) 1.7% ( -9% - 14%) 0.367
HighPhrase 99.05 (6.0%) 100.76
(5.8%) 1.7% ( -9% - 14%) 0.353
LowSpanNear 431.87 (6.1%) 439.48
(5.0%) 1.8% ( -8% - 13%) 0.315
Wildcard 137.01 (6.0%) 139.63
(6.4%) 1.9% ( -9% - 15%) 0.327
LowSloppyPhrase 93.66 (4.7%) 95.46
(4.1%) 1.9% ( -6% - 11%) 0.171
OrNotHighMed 788.91 (9.2%) 804.35
(10.3%) 2.0% ( -16% - 23%) 0.527
HighSloppyPhrase 57.33 (4.4%) 58.62
(5.1%) 2.3% ( -6% - 12%) 0.130
OrNotHighLow 2571.68 (4.8%) 2634.43
(6.8%) 2.4% ( -8% - 14%) 0.190
OrNotHighHigh 514.49 (7.5%) 528.04
(7.1%) 2.6% ( -11% - 18%) 0.254
OrHighNotHigh 718.29 (7.6%) 737.45
(8.7%) 2.7% ( -12% - 20%) 0.304
OrHighLow 1494.40 (8.4%) 1542.29
(5.7%) 3.2% ( -10% - 18%) 0.157
HighTerm 2004.22 (15.4%) 2073.93
(15.0%) 3.5% ( -23% - 40%) 0.470
BrowseDayOfYearSSDVFacets 26.24 (8.4%) 27.22
(10.7%) 3.7% ( -14% - 24%) 0.221
HighTermDayOfYearSort 476.74 (4.4%) 494.88
(6.5%) 3.8% ( -6% - 15%) 0.031
IntSet 1333.84 (11.9%) 1399.31
(11.2%) 4.9% ( -16% - 31%) 0.179
LowTerm 3018.32 (12.4%) 3166.82
(12.7%) 4.9% ( -17% - 34%) 0.215
BrowseMonthTaxoFacets 36.62 (30.3%) 40.10
(23.7%) 9.5% ( -34% - 91%) 0.269
```
(I left out the `WildcardLeadingAndMissing` query this time because it takes
too long)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
