msokolov commented on pull request #2176: URL: https://github.com/apache/lucene-solr/pull/2176#issuecomment-754299548
I ran benchmarks one more time, including vector tasks: ``` TaskQPS baseline StdDevQPS candidate StdDev Pct diff p-value BrowseMonthTaxoFacets 2.17 (6.3%) 1.17 (1.6%) -46.1% ( -50% - -40%) 0.000 BrowseDateTaxoFacets 2.06 (6.5%) 1.14 (1.7%) -44.7% ( -49% - -39%) 0.000 BrowseDayOfYearTaxoFacets 2.06 (6.5%) 1.14 (1.7%) -44.7% ( -49% - -38%) 0.000 Fuzzy2 50.14 (10.0%) 42.75 (9.0%) -14.7% ( -30% - 4%) 0.000 OrNotHighLow 471.70 (4.3%) 404.83 (3.7%) -14.2% ( -21% - -6%) 0.000 Respell 48.12 (1.8%) 41.51 (1.2%) -13.7% ( -16% - -11%) 0.000 BrowseMonthSSDVFacets 12.43 (7.9%) 10.88 (6.6%) -12.4% ( -24% - 2%) 0.000 PKLookup 134.94 (1.0%) 118.56 (1.1%) -12.1% ( -14% - -10%) 0.000 LowTerm 972.51 (3.9%) 870.89 (2.9%) -10.4% ( -16% - -3%) 0.000 AndHighLow 1256.92 (4.3%) 1126.63 (4.2%) -10.4% ( -18% - -1%) 0.000 HighTerm 938.27 (4.5%) 843.52 (3.7%) -10.1% ( -17% - -1%) 0.000 LowTermVector 821.50 (2.4%) 739.43 (1.4%) -10.0% ( -13% - -6%) 0.000 Wildcard 94.86 (2.1%) 85.51 (1.9%) -9.9% ( -13% - -6%) 0.000 OrHighMed 98.33 (3.0%) 88.70 (3.0%) -9.8% ( -15% - -3%) 0.000 AndHighLowVector 859.32 (2.2%) 775.74 (1.9%) -9.7% ( -13% - -5%) 0.000 AndHighMedVector 723.85 (4.0%) 654.44 (3.3%) -9.6% ( -16% - -2%) 0.000 AndHighHighVector 825.28 (1.7%) 746.88 (1.5%) -9.5% ( -12% - -6%) 0.000 MedTerm 1133.18 (4.2%) 1025.84 (2.6%) -9.5% ( -15% - -2%) 0.000 AndHighMed 163.82 (4.0%) 148.32 (3.3%) -9.5% ( -16% - -2%) 0.000 OrNotHighHigh 432.50 (4.6%) 391.92 (3.9%) -9.4% ( -17% - 0%) 0.000 MedTermVector 761.28 (3.9%) 690.36 (3.4%) -9.3% ( -15% - -2%) 0.000 MedSloppyPhrase 44.77 (2.3%) 40.61 (1.6%) -9.3% ( -12% - -5%) 0.000 OrHighNotHigh 457.14 (3.9%) 414.97 (5.6%) -9.2% ( -17% - 0%) 0.000 HighTermVector 814.15 (5.0%) 741.66 (5.0%) -8.9% ( -18% - 1%) 0.000 AndHighHigh 34.20 (3.6%) 31.39 (3.5%) -8.2% ( -14% - -1%) 0.000 OrHighLow 318.11 (7.2%) 292.68 (4.9%) -8.0% ( -18% - 4%) 0.000 OrNotHighMed 489.33 (4.3%) 451.73 (3.3%) -7.7% ( -14% - 0%) 0.000 MedPhrase 112.51 (2.1%) 103.95 (2.3%) -7.6% ( -11% - -3%) 0.000 HighSpanNear 9.46 (3.1%) 8.76 (2.1%) -7.4% ( -12% - -2%) 0.000 LowSloppyPhrase 98.59 (2.4%) 91.33 (1.3%) -7.4% ( -10% - -3%) 0.000 MedSpanNear 98.82 (2.6%) 91.64 (2.0%) -7.3% ( -11% - -2%) 0.000 Fuzzy1 52.63 (9.9%) 49.02 (5.8%) -6.9% ( -20% - 9%) 0.007 LowSpanNear 93.95 (2.1%) 87.52 (1.6%) -6.8% ( -10% - -3%) 0.000 HighPhrase 256.37 (3.7%) 239.54 (2.3%) -6.6% ( -12% - 0%) 0.000 Prefix3 227.65 (6.2%) 213.30 (5.9%) -6.3% ( -17% - 6%) 0.001 HighSloppyPhrase 9.96 (3.1%) 9.35 (2.2%) -6.1% ( -11% - 0%) 0.000 OrHighHigh 21.71 (2.6%) 20.54 (1.8%) -5.4% ( -9% - -1%) 0.000 OrHighNotMed 471.56 (6.3%) 446.92 (4.6%) -5.2% ( -15% - 5%) 0.003 OrHighNotLow 555.62 (4.9%) 526.59 (3.5%) -5.2% ( -13% - 3%) 0.000 HighTermDayOfYearSort 33.02 (9.4%) 31.30 (8.0%) -5.2% ( -20% - 13%) 0.058 LowPhrase 310.16 (4.3%) 295.71 (2.5%) -4.7% ( -11% - 2%) 0.000 HighIntervalsOrdered 12.32 (1.4%) 11.77 (1.3%) -4.5% ( -7% - -1%) 0.000 HighTermMonthSort 121.01 (14.0%) 116.57 (11.1%) -3.7% ( -25% - 24%) 0.358 BrowseDayOfYearSSDVFacets 9.72 (6.0%) 9.39 (1.7%) -3.3% ( -10% - 4%) 0.017 TermDTSort 96.25 (8.7%) 94.99 (8.3%) -1.3% ( -16% - 17%) 0.626 HighTermTitleBDVSort 102.37 (16.1%) 101.51 (16.7%) -0.8% ( -28% - 38%) 0.871 IntNRQ 203.00 (0.8%) 202.97 (0.7%) -0.0% ( -1% - 1%) 0.952 ``` ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For additional commands, e-mail: issues-h...@lucene.apache.org