prudhvigodithi commented on PR #15446:
URL: https://github.com/apache/lucene/pull/15446#issuecomment-3577215055
### Enable intra segment on candidate, baseline using `main` disabled intra
segment (the following run is without this PR optimization)
```
TaskQPS baseline StdDevQPS
my_modified_version StdDev Pct diff p-value
IntNRQ 58.91 (1.9%) 13.90
(0.3%) -76.4% ( -77% - -75%) 0.000
Wildcard 43.88 (4.0%) 10.57
(1.0%) -75.9% ( -77% - -73%) 0.000
Prefix3 281.97 (7.8%) 76.48
(1.1%) -72.9% ( -75% - -69%) 0.000
OrHighNotMed 311.22 (6.4%) 110.80
(2.9%) -64.4% ( -69% - -58%) 0.000
OrHighNotHigh 148.47 (10.9%) 53.37
(2.5%) -64.1% ( -69% - -56%) 0.000
HighTermMonthSort 519.10 (5.2%) 196.53
(1.8%) -62.1% ( -65% - -58%) 0.000
HighPhrase 19.04 (2.7%) 8.24
(1.6%) -56.7% ( -59% - -53%) 0.000
HighTermDayOfYearSort 76.20 (4.7%) 33.62
(1.3%) -55.9% ( -59% - -52%) 0.000
HighTerm 342.27 (11.9%) 159.15
(9.2%) -53.5% ( -66% - -36%) 0.000
IntSet 242.49 (6.3%) 138.24
(1.2%) -43.0% ( -47% - -37%) 0.000
LowTerm 438.69 (15.4%) 265.03
(12.7%) -39.6% ( -58% - -13%) 0.000
HighTermTitleSort 20.93 (3.3%) 12.79
(0.6%) -38.9% ( -41% - -36%) 0.000
OrNotHighHigh 237.69 (11.0%) 151.04
(2.9%) -36.5% ( -45% - -25%) 0.000
MedTerm 456.48 (11.3%) 313.47
(11.4%) -31.3% ( -48% - -9%) 0.000
TermDTSort 43.22 (6.8%) 31.36
(1.6%) -27.5% ( -33% - -20%) 0.000
OrHighMed 193.23 (9.7%) 147.57
(7.6%) -23.6% ( -37% - -7%) 0.000
OrNotHighMed 146.14 (6.9%) 113.02
(4.3%) -22.7% ( -31% - -12%) 0.000
Fuzzy1 48.10 (10.0%) 38.63
(5.6%) -19.7% ( -32% - -4%) 0.000
MedPhrase 113.33 (2.2%) 92.06
(2.2%) -18.8% ( -22% - -14%) 0.000
OrNotHighLow 547.98 (3.6%) 446.60
(3.9%) -18.5% ( -25% - -11%) 0.000
AndHighLow 535.11 (5.4%) 440.58
(3.0%) -17.7% ( -24% - -9%) 0.000
OrHighLow 414.70 (5.7%) 342.19
(4.4%) -17.5% ( -26% - -7%) 0.000
AndHighMedDayTaxoFacets 15.84 (4.7%) 13.24
(4.5%) -16.4% ( -24% - -7%) 0.000
AndHighHighDayTaxoFacets 16.50 (5.5%) 13.92
(1.0%) -15.6% ( -20% - -9%) 0.000
OrHighHigh 73.41 (13.6%) 62.44
(14.1%) -14.9% ( -37% - 14%) 0.087
BrowseDateSSDVFacets 0.62 (10.2%) 0.54
(10.0%) -13.5% ( -30% - 7%) 0.035
MedTermDayTaxoFacets 13.08 (6.8%) 11.35
(4.9%) -13.2% ( -23% - -1%) 0.000
BrowseDateTaxoFacets 2.31 (21.7%) 2.02
(4.8%) -12.8% ( -32% - 17%) 0.199
range 3310.16 (2.1%) 2956.59
(6.0%) -10.7% ( -18% - -2%) 0.000
MedSloppyPhrase 33.09 (1.7%) 30.04
(3.1%) -9.2% ( -13% - -4%) 0.000
LowPhrase 19.78 (2.4%) 18.15
(1.3%) -8.2% ( -11% - -4%) 0.000
HighSloppyPhrase 6.08 (3.3%) 5.58
(2.3%) -8.1% ( -13% - -2%) 0.000
OrHighMedDayTaxoFacets 5.88 (7.5%) 5.41
(4.9%) -8.1% ( -19% - 4%) 0.044
BrowseDayOfYearTaxoFacets 2.29 (17.9%) 2.13
(12.1%) -6.8% ( -31% - 28%) 0.479
Respell 24.52 (11.1%) 22.91
(14.1%) -6.6% ( -28% - 20%) 0.410
AndHighHigh 72.56 (9.5%) 68.81
(13.6%) -5.2% ( -25% - 19%) 0.486
BrowseRandomLabelTaxoFacets 1.80 (4.2%) 1.71
(5.4%) -5.1% ( -14% - 4%) 0.100
LowIntervalsOrdered 42.00 (2.0%) 40.00
(4.6%) -4.8% ( -11% - 1%) 0.034
HighTermTitleBDVSort 11.16 (5.0%) 10.64
(4.5%) -4.6% ( -13% - 5%) 0.123
HighIntervalsOrdered 10.10 (6.3%) 9.76
(6.6%) -3.4% ( -15% - 10%) 0.411
Fuzzy2 35.54 (4.9%) 34.46
(7.0%) -3.0% ( -14% - 9%) 0.429
OrHighNotLow 371.12 (9.4%) 363.35
(8.9%) -2.1% ( -18% - 17%) 0.717
MedSpanNear 109.73 (1.9%) 107.88
(2.9%) -1.7% ( -6% - 3%) 0.281
HighSpanNear 5.56 (3.9%) 5.68
(3.8%) 2.3% ( -5% - 10%) 0.353
BrowseMonthTaxoFacets 2.21 (11.4%) 2.27
(5.3%) 2.5% ( -12% - 21%) 0.651
BrowseRandomLabelSSDVFacets 1.97 (9.5%) 2.04
(13.3%) 3.4% ( -17% - 28%) 0.639
LowSpanNear 6.17 (4.4%) 6.42
(4.9%) 4.2% ( -4% - 14%) 0.153
MedIntervalsOrdered 13.25 (4.4%) 14.03
(5.5%) 5.9% ( -3% - 16%) 0.060
PKLookup 133.54 (12.5%) 144.12
(5.0%) 7.9% ( -8% - 29%) 0.188
BrowseDayOfYearSSDVFacets 2.66 (14.4%) 2.87
(19.8%) 8.1% ( -22% - 49%) 0.460
BrowseMonthSSDVFacets 2.97 (11.2%) 3.26
(17.0%) 9.6% ( -16% - 42%) 0.292
LowSloppyPhrase 14.93 (5.2%) 16.68
(3.9%) 11.8% ( 2% - 21%) 0.000
AndHighMed 157.26 (8.8%) 183.92
(4.6%) 17.0% ( 3% - 33%) 0.000
```
### Enable intra segment on candidate, baseline using `main` disabled intra
segment (the following run is with this PR optimization)
```
TaskQPS baseline StdDevQPS
my_modified_version StdDev Pct diff p-value
Prefix3 55.06 (0.0%) 12.45
(0.0%) -77.4% ( -77% - -77%) 1.000
Wildcard 80.75 (0.0%) 20.50
(0.0%) -74.6% ( -74% - -74%) 1.000
OrHighNotHigh 177.12 (0.0%) 51.88
(0.0%) -70.7% ( -70% - -70%) 1.000
TermDTSort 83.40 (0.0%) 28.37
(0.0%) -66.0% ( -65% - -65%) 1.000
HighTermDayOfYearSort 79.30 (0.0%) 27.37
(0.0%) -65.5% ( -65% - -65%) 1.000
HighTermMonthSort 518.20 (0.0%) 204.98
(0.0%) -60.4% ( -60% - -60%) 1.000
HighTermTitleSort 21.02 (0.0%) 8.51
(0.0%) -59.5% ( -59% - -59%) 1.000
OrNotHighHigh 85.37 (0.0%) 35.75
(0.0%) -58.1% ( -58% - -58%) 1.000
HighTerm 369.78 (0.0%) 182.48
(0.0%) -50.7% ( -50% - -50%) 1.000
OrHighNotMed 159.12 (0.0%) 86.82
(0.0%) -45.4% ( -45% - -45%) 1.000
MedTerm 417.55 (0.0%) 235.22
(0.0%) -43.7% ( -43% - -43%) 1.000
IntNRQ 50.11 (0.0%) 29.95
(0.0%) -40.2% ( -40% - -40%) 1.000
LowTerm 876.98 (0.0%) 531.99
(0.0%) -39.3% ( -39% - -39%) 1.000
IntSet 217.87 (0.0%) 134.06
(0.0%) -38.5% ( -38% - -38%) 1.000
OrNotHighMed 109.80 (0.0%) 75.63
(0.0%) -31.1% ( -31% - -31%) 1.000
MedPhrase 74.25 (0.0%) 53.28
(0.0%) -28.2% ( -28% - -28%) 1.000
OrHighNotLow 423.90 (0.0%) 314.32
(0.0%) -25.8% ( -25% - -25%) 1.000
Fuzzy2 46.24 (0.0%) 36.17
(0.0%) -21.8% ( -21% - -21%) 1.000
AndHighMed 161.59 (0.0%) 132.41
(0.0%) -18.1% ( -18% - -18%) 1.000
MedTermDayTaxoFacets 14.40 (0.0%) 12.07
(0.0%) -16.2% ( -16% - -16%) 1.000
OrHighLow 392.75 (0.0%) 330.70
(0.0%) -15.8% ( -15% - -15%) 1.000
OrNotHighLow 560.04 (0.0%) 471.98
(0.0%) -15.7% ( -15% - -15%) 1.000
LowPhrase 55.39 (0.0%) 47.97
(0.0%) -13.4% ( -13% - -13%) 1.000
BrowseRandomLabelSSDVFacets 2.36 (0.0%) 2.07
(0.0%) -12.1% ( -12% - -12%) 1.000
BrowseDayOfYearTaxoFacets 2.33 (0.0%) 2.06
(0.0%) -11.7% ( -11% - -11%) 1.000
OrHighMed 192.51 (0.0%) 170.16
(0.0%) -11.6% ( -11% - -11%) 1.000
AndHighHighDayTaxoFacets 8.70 (0.0%) 7.71
(0.0%) -11.4% ( -11% - -11%) 1.000
MedSpanNear 137.19 (0.0%) 122.43
(0.0%) -10.8% ( -10% - -10%) 1.000
Fuzzy1 35.18 (0.0%) 31.72
(0.0%) -9.9% ( -9% - -9%) 1.000
AndHighMedDayTaxoFacets 19.99 (0.0%) 18.07
(0.0%) -9.6% ( -9% - -9%) 1.000
AndHighLow 475.14 (0.0%) 444.08
(0.0%) -6.5% ( -6% - -6%) 1.000
OrHighMedDayTaxoFacets 2.36 (0.0%) 2.25
(0.0%) -4.6% ( -4% - -4%) 1.000
HighSloppyPhrase 5.86 (0.0%) 5.65
(0.0%) -3.5% ( -3% - -3%) 1.000
MedSloppyPhrase 51.54 (0.0%) 49.88
(0.0%) -3.2% ( -3% - -3%) 1.000
BrowseDateSSDVFacets 0.49 (0.0%) 0.48
(0.0%) -2.7% ( -2% - -2%) 1.000
AndHighHigh 69.88 (0.0%) 68.22
(0.0%) -2.4% ( -2% - -2%) 1.000
OrHighHigh 46.76 (0.0%) 45.70
(0.0%) -2.3% ( -2% - -2%) 1.000
PKLookup 155.07 (0.0%) 151.70
(0.0%) -2.2% ( -2% - -2%) 1.000
MedIntervalsOrdered 9.78 (0.0%) 9.71
(0.0%) -0.7% ( 0% - 0%) 1.000
LowSloppyPhrase 12.42 (0.0%) 12.58
(0.0%) 1.3% ( 1% - 1%) 1.000
LowIntervalsOrdered 9.69 (0.0%) 9.82
(0.0%) 1.3% ( 1% - 1%) 1.000
BrowseMonthTaxoFacets 2.26 (0.0%) 2.30
(0.0%) 1.6% ( 1% - 1%) 1.000
HighIntervalsOrdered 7.66 (0.0%) 7.91
(0.0%) 3.2% ( 3% - 3%) 1.000
HighSpanNear 3.84 (0.0%) 3.98
(0.0%) 3.6% ( 3% - 3%) 1.000
BrowseRandomLabelTaxoFacets 1.72 (0.0%) 1.79
(0.0%) 3.9% ( 3% - 3%) 1.000
range 2895.37 (0.0%) 3030.59
(0.0%) 4.7% ( 4% - 4%) 1.000
BrowseDateTaxoFacets 2.03 (0.0%) 2.18
(0.0%) 7.4% ( 7% - 7%) 1.000
HighTermTitleBDVSort 5.69 (0.0%) 6.19
(0.0%) 8.7% ( 8% - 8%) 1.000
HighPhrase 114.97 (0.0%) 127.61
(0.0%) 11.0% ( 11% - 11%) 1.000
LowSpanNear 8.80 (0.0%) 9.84
(0.0%) 11.9% ( 11% - 11%) 1.000
BrowseDayOfYearSSDVFacets 3.07 (0.0%) 3.56
(0.0%) 16.2% ( 16% - 16%) 1.000
BrowseMonthSSDVFacets 2.85 (0.0%) 3.37
(0.0%) 18.4% ( 18% - 18%) 1.000
Respell 17.39 (0.0%) 24.42
(0.0%) 40.4% ( 40% - 40%) 1.000
```
### Enable intra segment on baseline and candidate and using this PR
optimization
```
TaskQPS baseline StdDevQPS
my_modified_version StdDev Pct diff p-value
PKLookup 153.07 (0.2%) 111.11
(4.4%) -27.4% ( -31% - -22%) 0.000
HighTermTitleBDVSort 8.90 (3.4%) 8.30
(3.7%) -6.7% ( -13% - 0%) 0.056
AndHighMedDayTaxoFacets 65.36 (4.8%) 61.21
(0.8%) -6.3% ( -11% - 0%) 0.066
HighIntervalsOrdered 4.95 (4.7%) 4.64
(0.3%) -6.2% ( -10% - -1%) 0.065
Wildcard 149.60 (2.6%) 140.62
(1.4%) -6.0% ( -9% - -2%) 0.004
MedIntervalsOrdered 27.11 (10.0%) 25.56
(0.2%) -5.7% ( -14% - 4%) 0.417
BrowseRandomLabelTaxoFacets 1.76 (7.1%) 1.67
(1.7%) -5.2% ( -13% - 3%) 0.310
OrHighLow 177.49 (3.9%) 168.38
(1.7%) -5.1% ( -10% - 0%) 0.089
OrHighNotMed 125.49 (4.9%) 119.42
(4.2%) -4.8% ( -13% - 4%) 0.292
LowSpanNear 37.85 (2.4%) 36.31
(1.7%) -4.1% ( -7% - 0%) 0.047
MedTermDayTaxoFacets 12.65 (3.1%) 12.23
(8.0%) -3.3% ( -13% - 8%) 0.584
BrowseRandomLabelSSDVFacets 2.18 (26.1%) 2.12
(23.9%) -3.0% ( -42% - 63%) 0.905
OrNotHighLow 575.10 (1.6%) 559.18
(1.6%) -2.8% ( -5% - 0%) 0.079
LowIntervalsOrdered 17.79 (5.3%) 17.33
(0.0%) -2.6% ( -7% - 2%) 0.493
HighSpanNear 10.59 (1.2%) 10.34
(0.6%) -2.3% ( -4% - 0%) 0.016
LowSloppyPhrase 7.31 (0.4%) 7.16
(1.5%) -2.0% ( -3% - 0%) 0.062
MedPhrase 26.16 (2.7%) 25.65
(1.8%) -2.0% ( -6% - 2%) 0.384
HighTermDayOfYearSort 24.80 (0.7%) 24.38
(1.1%) -1.7% ( -3% - 0%) 0.059
MedTerm 385.18 (0.8%) 379.60
(2.2%) -1.4% ( -4% - 1%) 0.392
HighTerm 246.26 (0.4%) 242.70
(0.6%) -1.4% ( -2% - 0%) 0.003
OrNotHighMed 57.72 (5.0%) 56.91
(4.4%) -1.4% ( -10% - 8%) 0.767
OrHighNotLow 179.56 (8.6%) 177.42
(1.5%) -1.2% ( -10% - 9%) 0.847
MedSpanNear 18.34 (3.3%) 18.17
(1.2%) -0.9% ( -5% - 3%) 0.712
OrHighMed 159.74 (1.0%) 158.67
(0.0%) -0.7% ( -1% - 0%) 0.319
OrNotHighHigh 103.55 (3.7%) 102.95
(5.3%) -0.6% ( -9% - 8%) 0.899
AndHighHighDayTaxoFacets 3.47 (1.7%) 3.46
(0.2%) -0.3% ( -2% - 1%) 0.794
MedSloppyPhrase 9.25 (0.4%) 9.23
(3.6%) -0.2% ( -4% - 3%) 0.926
HighTermTitleSort 10.68 (6.1%) 10.68
(1.2%) -0.1% ( -6% - 7%) 0.988
IntSet 143.67 (1.7%) 143.65
(2.4%) -0.0% ( -4% - 4%) 0.996
AndHighMed 191.95 (2.3%) 192.16
(1.5%) 0.1% ( -3% - 4%) 0.955
AndHighLow 534.50 (3.1%) 535.67
(2.7%) 0.2% ( -5% - 6%) 0.940
BrowseDayOfYearSSDVFacets 2.88 (12.0%) 2.89
(25.2%) 0.5% ( -32% - 42%) 0.981
HighTermMonthSort 202.36 (2.9%) 203.85
(14.0%) 0.7% ( -15% - 18%) 0.942
OrHighHigh 58.36 (0.7%) 58.86
(0.6%) 0.8% ( 0% - 2%) 0.196
HighSloppyPhrase 20.06 (0.5%) 20.23
(0.6%) 0.8% ( 0% - 1%) 0.131
OrHighNotHigh 67.11 (68.0%) 67.78
(57.7%) 1.0% ( -74% - 395%) 0.987
AndHighHigh 83.60 (0.8%) 84.53
(1.5%) 1.1% ( -1% - 3%) 0.354
TermDTSort 26.40 (2.0%) 26.75
(1.5%) 1.3% ( -2% - 4%) 0.449
LowPhrase 134.22 (7.9%) 136.19
(0.4%) 1.5% ( -6% - 10%) 0.794
Fuzzy2 29.68 (4.5%) 30.19
(2.5%) 1.7% ( -5% - 9%) 0.634
Prefix3 54.66 (2.4%) 56.57
(7.9%) 3.5% ( -6% - 14%) 0.548
LowTerm 563.86 (1.0%) 584.85
(3.7%) 3.7% ( 0% - 8%) 0.171
BrowseMonthTaxoFacets 2.06 (0.1%) 2.15
(19.9%) 4.4% ( -15% - 24%) 0.757
BrowseMonthSSDVFacets 2.86 (17.6%) 3.02
(5.9%) 5.5% ( -15% - 35%) 0.673
OrHighMedDayTaxoFacets 2.94 (0.7%) 3.11
(10.8%) 5.7% ( -5% - 17%) 0.457
BrowseDayOfYearTaxoFacets 2.12 (1.4%) 2.26
(36.9%) 6.4% ( -31% - 45%) 0.807
Respell 26.71 (3.1%) 28.55
(1.4%) 6.9% ( 2% - 11%) 0.004
HighPhrase 3.58 (0.3%) 3.83
(12.7%) 7.1% ( -5% - 20%) 0.434
BrowseDateTaxoFacets 2.23 (9.4%) 2.43
(21.2%) 9.3% ( -19% - 43%) 0.572
range 2598.11 (7.1%) 2860.33
(5.9%) 10.1% ( -2% - 24%) 0.121
Fuzzy1 37.34 (10.1%) 43.48
(3.4%) 16.5% ( 2% - 33%) 0.029
BrowseDateSSDVFacets 0.50 (7.1%) 0.65
(3.1%) 30.5% ( 18% - 43%) 0.000
IntNRQ 11.37 (1.0%) 27.37
(9.7%) 140.7% ( 128% - 152%) 0.000
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
