mikemccand commented on PR #12631: URL: https://github.com/apache/lucene/pull/12631#issuecomment-1752064474
`luceneutil` results on `wikimediumall` look good -- looks like all noise
(even for `PKLookup`), or, any signal (change) is very low, making the ~15%
reduction very much worth it.
```
Task QPS base StdDevQPS msb_vlong
StdDev Pct diff p-value
BrowseMonthTaxoFacets 8.34 (4.4%) 8.24
(3.6%) -1.2% ( -8% - 7%) 0.344
HighIntervalsOrdered 11.37 (3.9%) 11.24
(4.5%) -1.2% ( -9% - 7%) 0.382
OrHighLow 394.28 (1.6%) 390.47
(2.1%) -1.0% ( -4% - 2%) 0.099
MedSpanNear 24.41 (3.9%) 24.23
(3.9%) -0.8% ( -8% - 7%) 0.537
MedIntervalsOrdered 9.96 (4.0%) 9.89
(4.3%) -0.7% ( -8% - 7%) 0.602
LowSpanNear 13.82 (3.2%) 13.73
(3.2%) -0.6% ( -6% - 5%) 0.526
AndHighHigh 97.28 (1.9%) 96.71
(1.2%) -0.6% ( -3% - 2%) 0.259
BrowseRandomLabelSSDVFacets 9.22 (4.5%) 9.17
(4.3%) -0.6% ( -8% - 8%) 0.688
LowIntervalsOrdered 28.78 (4.0%) 28.64
(4.1%) -0.5% ( -8% - 7%) 0.720
PKLookup 250.58 (0.9%) 249.44
(1.0%) -0.5% ( -2% - 1%) 0.118
IntNRQ 315.77 (2.5%) 314.47
(2.1%) -0.4% ( -4% - 4%) 0.570
BrowseDayOfYearSSDVFacets 12.75 (7.3%) 12.70
(10.5%) -0.4% ( -16% - 18%) 0.887
HighPhrase 55.21 (3.5%) 55.00
(2.8%) -0.4% ( -6% - 6%) 0.712
MedPhrase 77.25 (2.0%) 77.04
(1.9%) -0.3% ( -4% - 3%) 0.658
HighSloppyPhrase 6.90 (3.9%) 6.89
(3.4%) -0.2% ( -7% - 7%) 0.841
LowPhrase 463.60 (1.4%) 462.90
(1.1%) -0.2% ( -2% - 2%) 0.701
OrNotHighMed 424.68 (2.6%) 424.06
(2.5%) -0.1% ( -5% - 5%) 0.857
AndHighLow 680.76 (1.3%) 679.77
(1.6%) -0.1% ( -3% - 2%) 0.757
HighSpanNear 27.40 (1.5%) 27.37
(1.3%) -0.1% ( -2% - 2%) 0.787
AndHighMed 200.30 (1.3%) 200.12
(1.3%) -0.1% ( -2% - 2%) 0.826
OrNotHighLow 622.80 (1.2%) 622.27
(1.1%) -0.1% ( -2% - 2%) 0.816
LowSloppyPhrase 7.73 (2.9%) 7.73
(3.0%) -0.1% ( -5% - 6%) 0.951
HighTermMonthSort 4175.08 (1.1%) 4173.92
(0.9%) -0.0% ( -1% - 1%) 0.929
TermDTSort 268.34 (2.0%) 268.37
(2.3%) 0.0% ( -4% - 4%) 0.988
HighTermDayOfYearSort 779.14 (1.1%) 779.57
(0.9%) 0.1% ( -1% - 2%) 0.867
Wildcard 163.23 (1.1%) 163.33
(1.3%) 0.1% ( -2% - 2%) 0.867
BrowseDateTaxoFacets 8.27 (4.4%) 8.28
(4.2%) 0.1% ( -8% - 9%) 0.936
Respell 44.69 (0.7%) 44.74
(0.9%) 0.1% ( -1% - 1%) 0.642
MedSloppyPhrase 37.55 (2.1%) 37.62
(1.8%) 0.2% ( -3% - 4%) 0.792
OrHighHigh 44.44 (2.6%) 44.52
(3.3%) 0.2% ( -5% - 6%) 0.845
BrowseDayOfYearTaxoFacets 8.22 (4.2%) 8.24
(4.1%) 0.2% ( -7% - 8%) 0.888
HighTermTitleSort 146.90 (2.9%) 147.22
(2.5%) 0.2% ( -5% - 5%) 0.796
AndHighMedDayTaxoFacets 47.61 (2.0%) 47.72
(1.5%) 0.2% ( -3% - 3%) 0.679
OrNotHighHigh 479.52 (3.7%) 480.64
(3.5%) 0.2% ( -6% - 7%) 0.837
OrHighNotMed 675.60 (4.5%) 677.32
(4.3%) 0.3% ( -8% - 9%) 0.856
BrowseMonthSSDVFacets 13.96 (10.1%) 14.01
(12.1%) 0.3% ( -19% - 25%) 0.928
Prefix3 282.37 (1.2%) 283.46
(1.2%) 0.4% ( -2% - 2%) 0.321
Fuzzy2 60.02 (0.6%) 60.27
(0.8%) 0.4% ( -1% - 1%) 0.068
Fuzzy1 48.28 (1.3%) 48.50
(1.0%) 0.5% ( -1% - 2%) 0.210
AndHighHighDayTaxoFacets 11.30 (1.1%) 11.35
(1.5%) 0.5% ( -2% - 3%) 0.264
OrHighMed 179.94 (1.7%) 180.80
(2.2%) 0.5% ( -3% - 4%) 0.446
HighTermTitleBDVSort 6.77 (2.6%) 6.80
(2.4%) 0.5% ( -4% - 5%) 0.541
LowTerm 732.59 (1.7%) 736.71
(2.5%) 0.6% ( -3% - 4%) 0.404
BrowseRandomLabelTaxoFacets 7.44 (2.8%) 7.49
(2.9%) 0.6% ( -4% - 6%) 0.485
OrHighNotLow 683.54 (5.7%) 687.86
(5.7%) 0.6% ( -10% - 12%) 0.726
OrHighNotHigh 352.91 (5.1%) 355.64
(5.2%) 0.8% ( -9% - 11%) 0.635
MedTermDayTaxoFacets 39.46 (1.9%) 39.79
(2.5%) 0.8% ( -3% - 5%) 0.249
OrHighMedDayTaxoFacets 2.64 (3.3%) 2.66
(3.1%) 0.8% ( -5% - 7%) 0.412
MedTerm 655.15 (4.7%) 660.94
(6.2%) 0.9% ( -9% - 12%) 0.614
HighTerm 683.48 (5.0%) 689.63
(6.3%) 0.9% ( -9% - 12%) 0.617
BrowseDateSSDVFacets 2.17 (1.1%) 2.19
(3.1%) 1.3% ( -2% - 5%) 0.082
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org
