[ https://issues.apache.org/jira/browse/LUCENE-10334 ]
Feng Guo deleted comment on LUCENE-10334:
-----------------------------------
was (Author: gf2121):
In the 'detect warm up' approach, I unrolled the block decode codes, speed it
up a bit:
{code:java}
TaskQPS baseline StdDevQPS my_modified_version
StdDev Pct diff p-value
MedTermDayTaxoFacets 55.17 (6.5%) 53.38
(7.1%) -3.2% ( -15% - 11%) 0.129
Wildcard 309.31 (12.9%) 299.80
(12.6%) -3.1% ( -25% - 25%) 0.446
OrNotHighLow 696.18 (8.7%) 677.46
(10.1%) -2.7% ( -19% - 17%) 0.367
HighTerm 1183.05 (9.5%) 1151.67
(9.2%) -2.7% ( -19% - 17%) 0.368
OrHighMed 120.60 (7.0%) 117.55
(7.8%) -2.5% ( -16% - 13%) 0.279
OrHighMedDayTaxoFacets 9.46 (7.5%) 9.25
(6.7%) -2.2% ( -15% - 12%) 0.320
Prefix3 177.41 (7.3%) 173.96
(10.3%) -1.9% ( -18% - 16%) 0.489
AndHighHighDayTaxoFacets 28.81 (6.7%) 28.35
(6.3%) -1.6% ( -13% - 12%) 0.433
BrowseMonthTaxoFacets 13.50 (13.4%) 13.30
(6.6%) -1.5% ( -18% - 21%) 0.658
AndHighMedDayTaxoFacets 46.43 (7.8%) 45.75
(7.3%) -1.5% ( -15% - 14%) 0.540
MedPhrase 360.70 (8.5%) 355.47
(8.3%) -1.4% ( -16% - 16%) 0.587
AndHighMed 233.52 (6.7%) 230.19
(7.0%) -1.4% ( -14% - 13%) 0.510
HighTermTitleBDVSort 72.17 (16.9%) 71.14
(15.4%) -1.4% ( -28% - 37%) 0.780
OrHighNotMed 659.68 (9.7%) 650.38
(12.6%) -1.4% ( -21% - 23%) 0.691
HighPhrase 73.05 (7.6%) 72.25
(9.3%) -1.1% ( -16% - 17%) 0.685
TermDTSort 123.29 (15.5%) 122.10
(13.8%) -1.0% ( -26% - 33%) 0.835
IntNRQ 167.75 (7.4%) 166.17
(8.6%) -0.9% ( -15% - 16%) 0.710
OrHighNotHigh 890.84 (13.2%) 883.31
(11.5%) -0.8% ( -22% - 27%) 0.828
OrHighLow 279.24 (7.5%) 276.97
(6.6%) -0.8% ( -13% - 14%) 0.718
PKLookup 198.13 (6.6%) 196.54
(6.9%) -0.8% ( -13% - 13%) 0.707
MedSloppyPhrase 94.28 (8.0%) 93.55
(6.5%) -0.8% ( -14% - 14%) 0.737
AndHighLow 574.70 (8.2%) 570.50
(9.6%) -0.7% ( -17% - 18%) 0.795
OrNotHighMed 717.34 (11.5%) 712.33
(12.4%) -0.7% ( -22% - 26%) 0.853
AndHighHigh 61.26 (7.2%) 60.84
(6.3%) -0.7% ( -13% - 13%) 0.753
HighSloppyPhrase 6.56 (6.5%) 6.52
(5.3%) -0.7% ( -11% - 11%) 0.729
LowSloppyPhrase 159.12 (6.9%) 158.23
(6.5%) -0.6% ( -13% - 13%) 0.794
LowPhrase 88.55 (8.6%) 88.07
(8.6%) -0.5% ( -16% - 18%) 0.844
MedSpanNear 14.63 (6.1%) 14.55
(5.3%) -0.5% ( -11% - 11%) 0.786
Fuzzy2 24.31 (9.5%) 24.19
(7.7%) -0.5% ( -16% - 18%) 0.858
MedTerm 1440.59 (9.8%) 1433.53
(11.5%) -0.5% ( -19% - 23%) 0.885
HighSpanNear 23.52 (6.1%) 23.40
(5.9%) -0.5% ( -11% - 12%) 0.797
OrHighHigh 32.01 (8.4%) 31.96
(5.7%) -0.1% ( -13% - 15%) 0.948
Fuzzy1 82.31 (11.7%) 82.30
(13.5%) -0.0% ( -22% - 28%) 0.998
OrHighNotLow 724.27 (9.5%) 724.70
(10.1%) 0.1% ( -17% - 21%) 0.985
HighTermDayOfYearSort 156.00 (14.4%) 156.22
(14.6%) 0.1% ( -25% - 33%) 0.975
Respell 68.40 (8.2%) 68.49
(7.6%) 0.1% ( -14% - 17%) 0.955
MedIntervalsOrdered 9.22 (7.4%) 9.23
(6.9%) 0.2% ( -13% - 15%) 0.936
OrNotHighHigh 571.66 (8.1%) 572.72
(10.9%) 0.2% ( -17% - 20%) 0.951
LowSpanNear 82.39 (7.1%) 82.57
(4.4%) 0.2% ( -10% - 12%) 0.907
LowTerm 1355.15 (10.2%) 1358.89
(10.0%) 0.3% ( -18% - 22%) 0.931
HighTermMonthSort 58.72 (20.8%) 58.95
(20.1%) 0.4% ( -33% - 52%) 0.950
LowIntervalsOrdered 117.01 (7.2%) 117.50
(6.2%) 0.4% ( -12% - 14%) 0.844
HighIntervalsOrdered 13.76 (8.8%) 13.82
(6.8%) 0.5% ( -13% - 17%) 0.841
BrowseRandomLabelTaxoFacets 11.40 (10.0%) 13.34
(15.0%) 17.0% ( -7% - 46%) 0.000
BrowseDayOfYearTaxoFacets 13.32 (11.5%) 15.71
(15.0%) 17.9% ( -7% - 50%) 0.000
BrowseDateTaxoFacets 13.15 (11.3%) 15.64
(14.6%) 18.9% ( -6% - 50%) 0.000
BrowseRandomLabelSSDVFacets 10.03 (7.9%) 12.20
(10.1%) 21.6% ( 3% - 43%) 0.000
BrowseMonthSSDVFacets 15.27 (6.9%) 19.16
(10.8%) 25.4% ( 7% - 46%) 0.000
BrowseDayOfYearSSDVFacets 13.88 (6.0%) 18.71
(11.8%) 34.7% ( 15% - 55%) 0.000
{code}
> Introduce a BlockReader based on ForUtil and use it for NumericDocValues
> ------------------------------------------------------------------------
>
> Key: LUCENE-10334
> URL: https://issues.apache.org/jira/browse/LUCENE-10334
> Project: Lucene - Core
> Issue Type: Improvement
> Components: core/codecs
> Reporter: Feng Guo
> Priority: Major
> Time Spent: 50m
> Remaining Estimate: 0h
>
> Previous talk is here: [https://github.com/apache/lucene/pull/557]
> This is trying to add a new BlockReader based on ForUtil to replace the
> DirectReader we are using for NumericDocvalues
> -*Benchmark based on wiki10m*- (Previous benchmark results are wrong so i
> deleted it to avoid misleading, let's see the benchmark in comments.)
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org
