msokolov commented on pull request #2176:
URL: https://github.com/apache/lucene-solr/pull/2176#issuecomment-758175143
@uschindler I pulled latest from this branch
(ba61072221905c202450034c0c90409f7073ebb3) and re-ran (comparing to updated
master (6711eb7571727552aad3ace53c52c9a8fe07dc40) and see similar results:
```
TaskQPS baseline StdDevQPS candidate StdDev
Pct diff p-value
BrowseMonthTaxoFacets 2.15 (7.0%) 1.20 (5.6%)
-44.2% ( -53% - -33%) 0.000
BrowseDayOfYearTaxoFacets 2.04 (7.1%) 1.16 (5.8%)
-42.9% ( -52% - -32%) 0.000
BrowseDateTaxoFacets 2.04 (7.1%) 1.17 (5.8%)
-42.8% ( -51% - -32%) 0.000
LowTerm 1099.09 (4.8%) 936.16 (3.2%)
-14.8% ( -21% - -7%) 0.000
OrNotHighLow 523.44 (7.0%) 450.50 (3.8%)
-13.9% ( -23% - -3%) 0.000
Respell 42.23 (2.2%) 36.71 (2.5%)
-13.1% ( -17% - -8%) 0.000
AndHighMedVector 893.77 (2.9%) 786.53 (3.0%)
-12.0% ( -17% - -6%) 0.000
AndHighLow 662.65 (2.9%) 584.68 (2.0%)
-11.8% ( -16% - -7%) 0.000
PKLookup 136.02 (1.5%) 120.03 (1.5%)
-11.8% ( -14% - -8%) 0.000
Fuzzy1 53.41 (6.4%) 47.18 (5.4%)
-11.7% ( -22% - 0%) 0.000
MedTermVector 1067.80 (3.2%) 946.10 (2.3%)
-11.4% ( -16% - -6%) 0.000
AndHighLowVector 941.02 (3.8%) 834.30 (3.1%)
-11.3% ( -17% - -4%) 0.000
AndHighHighVector 908.27 (2.9%) 808.05 (2.1%)
-11.0% ( -15% - -6%) 0.000
LowTermVector 1010.16 (2.2%) 899.95 (1.9%)
-10.9% ( -14% - -6%) 0.000
MedTerm 1167.78 (3.9%) 1043.79 (3.1%)
-10.6% ( -17% - -3%) 0.000
BrowseMonthSSDVFacets 11.99 (13.4%) 10.73 (7.4%)
-10.5% ( -27% - 11%) 0.002
AndHighMed 155.89 (3.5%) 139.90 (2.8%)
-10.3% ( -16% - -4%) 0.000
OrNotHighMed 464.05 (4.1%) 416.91 (4.1%)
-10.2% ( -17% - -2%) 0.000
HighTermVector 1222.14 (3.5%) 1105.22 (2.2%)
-9.6% ( -14% - -4%) 0.000
Wildcard 91.66 (2.2%) 83.55 (2.4%)
-8.9% ( -13% - -4%) 0.000
LowSloppyPhrase 46.92 (2.1%) 42.77 (1.5%)
-8.8% ( -12% - -5%) 0.000
LowSpanNear 87.56 (2.7%) 80.02 (2.0%)
-8.6% ( -13% - -3%) 0.000
OrHighNotMed 470.32 (5.4%) 429.87 (3.3%)
-8.6% ( -16% - 0%) 0.000
HighTerm 1269.54 (7.1%) 1163.40 (5.8%)
-8.4% ( -19% - 4%) 0.000
OrHighNotHigh 430.03 (4.1%) 395.13 (4.3%)
-8.1% ( -15% - 0%) 0.000
OrHighNotLow 585.18 (5.0%) 537.96 (5.5%)
-8.1% ( -17% - 2%) 0.000
AndHighHigh 37.46 (3.2%) 34.45 (2.6%)
-8.0% ( -13% - -2%) 0.000
OrHighLow 576.99 (7.4%) 533.08 (6.4%)
-7.6% ( -19% - 6%) 0.001
HighPhrase 261.45 (2.1%) 241.99 (1.8%)
-7.4% ( -11% - -3%) 0.000
LowPhrase 375.57 (3.3%) 347.95 (3.7%)
-7.4% ( -13% - 0%) 0.000
HighSpanNear 20.85 (2.8%) 19.36 (2.0%)
-7.2% ( -11% - -2%) 0.000
MedPhrase 22.28 (1.8%) 20.77 (1.2%)
-6.8% ( -9% - -3%) 0.000
MedSloppyPhrase 15.96 (3.0%) 14.92 (2.5%)
-6.5% ( -11% - 0%) 0.000
Prefix3 204.87 (2.0%) 193.03 (2.2%)
-5.8% ( -9% - -1%) 0.000
OrNotHighHigh 496.09 (6.6%) 467.47 (4.1%)
-5.8% ( -15% - 5%) 0.001
HighSloppyPhrase 22.22 (4.0%) 21.02 (3.0%)
-5.4% ( -11% - 1%) 0.000
HighTermMonthSort 132.66 (11.4%) 126.18 (13.2%)
-4.9% ( -26% - 22%) 0.211
TermDTSort 68.55 (13.3%) 65.22 (15.1%)
-4.9% ( -29% - 27%) 0.279
OrHighMed 78.75 (3.8%) 74.95 (2.6%)
-4.8% ( -10% - 1%) 0.000
MedSpanNear 29.19 (2.3%) 27.83 (1.9%)
-4.7% ( -8% - 0%) 0.000
HighTermDayOfYearSort 105.52 (12.0%) 101.55 (10.1%)
-3.8% ( -23% - 20%) 0.284
IntNRQ 76.00 (12.3%) 73.29 (11.9%)
-3.6% ( -24% - 23%) 0.351
HighIntervalsOrdered 21.82 (1.5%) 21.05 (1.5%)
-3.5% ( -6% - 0%) 0.000
HighTermTitleBDVSort 114.39 (16.4%) 110.77 (14.9%)
-3.2% ( -29% - 33%) 0.522
OrHighHigh 16.17 (3.5%) 15.68 (2.8%)
-3.1% ( -9% - 3%) 0.002
BrowseDayOfYearSSDVFacets 9.57 (9.0%) 9.29 (5.2%)
-2.9% ( -15% - 12%) 0.221
Fuzzy2 30.01 (8.5%) 30.26 (10.2%)
0.8% ( -16% - 21%) 0.781
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org
