gsmiller commented on pull request #443:
URL: https://github.com/apache/lucene/pull/443#issuecomment-973151611
For posterity, I re-ran benchmarks with this most recent change, comparing
against `branch_9_0` as a baseline (so it includes all the back-compat checks
and such). Results still look very good:
```
TaskQPS baseline StdDevQPS candidate
StdDev Pct diff p-value
HighTermDayOfYearSort 127.51 (15.4%) 124.04
(12.1%) -2.7% ( -26% - 29%) 0.534
TermDTSort 96.36 (15.3%) 94.54
(15.1%) -1.9% ( -28% - 33%) 0.695
HighTermMonthSort 135.11 (13.3%) 133.31
(16.3%) -1.3% ( -27% - 32%) 0.778
Fuzzy1 63.28 (8.3%) 62.55
(8.6%) -1.2% ( -16% - 17%) 0.662
PKLookup 152.55 (2.1%) 151.14
(1.8%) -0.9% ( -4% - 3%) 0.139
MedIntervalsOrdered 82.93 (3.3%) 82.62
(2.4%) -0.4% ( -5% - 5%) 0.681
BrowseDayOfYearSSDVFacets 14.45 (14.5%) 14.40
(14.1%) -0.3% ( -25% - 33%) 0.945
HighTermTitleBDVSort 106.51 (21.3%) 106.18
(21.6%) -0.3% ( -35% - 54%) 0.964
MedTerm 1238.25 (2.3%) 1235.30
(2.5%) -0.2% ( -4% - 4%) 0.753
LowIntervalsOrdered 112.01 (2.2%) 111.75
(1.9%) -0.2% ( -4% - 4%) 0.724
Prefix3 246.62 (2.2%) 246.10
(2.2%) -0.2% ( -4% - 4%) 0.764
MedSloppyPhrase 72.18 (2.9%) 72.06
(3.0%) -0.2% ( -5% - 5%) 0.861
OrHighNotHigh 530.67 (2.9%) 529.98
(2.1%) -0.1% ( -5% - 5%) 0.873
OrHighNotLow 581.58 (3.3%) 581.28
(2.3%) -0.1% ( -5% - 5%) 0.954
BrowseMonthSSDVFacets 14.32 (4.5%) 14.32
(4.5%) -0.0% ( -8% - 9%) 0.977
MedPhrase 200.56 (1.9%) 200.54
(1.9%) -0.0% ( -3% - 3%) 0.992
OrHighNotMed 600.02 (2.7%) 599.99
(3.1%) -0.0% ( -5% - 5%) 0.995
IntNRQ 56.03 (3.5%) 56.03
(3.5%) 0.0% ( -6% - 7%) 0.995
HighIntervalsOrdered 1.86 (2.2%) 1.86
(2.2%) 0.1% ( -4% - 4%) 0.908
LowSpanNear 44.66 (1.7%) 44.70
(1.6%) 0.1% ( -3% - 3%) 0.874
HighTerm 974.66 (3.1%) 975.67
(2.8%) 0.1% ( -5% - 6%) 0.912
Respell 59.10 (1.8%) 59.17
(1.9%) 0.1% ( -3% - 3%) 0.849
HighPhrase 30.48 (1.9%) 30.52
(1.8%) 0.1% ( -3% - 3%) 0.819
OrHighLow 310.16 (2.6%) 310.61
(2.3%) 0.1% ( -4% - 5%) 0.849
LowTerm 1419.43 (2.7%) 1421.64
(2.5%) 0.2% ( -4% - 5%) 0.851
MedSpanNear 14.05 (2.3%) 14.08
(2.2%) 0.2% ( -4% - 4%) 0.798
LowPhrase 218.41 (4.5%) 218.81
(4.7%) 0.2% ( -8% - 9%) 0.899
OrNotHighHigh 531.27 (2.5%) 532.41
(2.1%) 0.2% ( -4% - 4%) 0.768
LowSloppyPhrase 23.57 (1.6%) 23.63
(1.8%) 0.2% ( -3% - 3%) 0.649
HighSloppyPhrase 34.72 (2.0%) 34.83
(2.0%) 0.3% ( -3% - 4%) 0.595
OrNotHighLow 786.86 (2.0%) 789.56
(1.9%) 0.3% ( -3% - 4%) 0.580
HighSpanNear 32.06 (2.9%) 32.17
(2.6%) 0.3% ( -4% - 5%) 0.690
AndHighMed 210.90 (3.2%) 212.04
(3.1%) 0.5% ( -5% - 7%) 0.589
Wildcard 106.13 (3.0%) 106.83
(3.3%) 0.7% ( -5% - 7%) 0.505
OrHighMed 60.24 (2.3%) 60.69
(2.4%) 0.7% ( -3% - 5%) 0.318
AndHighHigh 54.27 (3.3%) 54.70
(3.3%) 0.8% ( -5% - 7%) 0.448
AndHighLow 514.75 (2.5%) 518.95
(2.3%) 0.8% ( -3% - 5%) 0.284
OrHighHigh 25.30 (2.5%) 25.51
(2.3%) 0.8% ( -3% - 5%) 0.274
OrNotHighMed 636.45 (2.8%) 643.57
(2.8%) 1.1% ( -4% - 6%) 0.204
Fuzzy2 49.98 (7.1%) 50.55
(7.0%) 1.2% ( -12% - 16%) 0.605
AndHighHighDayTaxoFacets 23.04 (2.6%) 26.15
(2.8%) 13.5% ( 7% - 19%) 0.000
AndHighMedDayTaxoFacets 44.10 (2.3%) 53.02
(3.1%) 20.2% ( 14% - 26%) 0.000
MedTermDayTaxoFacets 22.03 (3.9%) 31.37
(3.7%) 42.4% ( 33% - 51%) 0.000
OrHighMedDayTaxoFacets 6.94 (3.0%) 10.00
(4.2%) 44.0% ( 35% - 52%) 0.000
BrowseMonthTaxoFacets 2.58 (7.7%) 12.74
(71.1%) 393.7% ( 292% - 511%) 0.000
BrowseDateTaxoFacets 2.43 (7.2%) 12.46
(78.3%) 412.0% ( 304% - 536%) 0.000
BrowseDayOfYearTaxoFacets 2.43 (7.2%) 12.48
(78.6%) 412.5% ( 304% - 536%) 0.000
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
