msokolov commented on pull request #2176:
URL: https://github.com/apache/lucene-solr/pull/2176#issuecomment-754299548


   I ran benchmarks one more time, including vector tasks:
   
   ```
                       TaskQPS baseline      StdDevQPS candidate      StdDev    
            Pct diff p-value
      BrowseMonthTaxoFacets        2.17      (6.3%)        1.17      (1.6%)  
-46.1% ( -50% -  -40%) 0.000
       BrowseDateTaxoFacets        2.06      (6.5%)        1.14      (1.7%)  
-44.7% ( -49% -  -39%) 0.000
   BrowseDayOfYearTaxoFacets        2.06      (6.5%)        1.14      (1.7%)  
-44.7% ( -49% -  -38%) 0.000
                     Fuzzy2       50.14     (10.0%)       42.75      (9.0%)  
-14.7% ( -30% -    4%) 0.000
               OrNotHighLow      471.70      (4.3%)      404.83      (3.7%)  
-14.2% ( -21% -   -6%) 0.000
                    Respell       48.12      (1.8%)       41.51      (1.2%)  
-13.7% ( -16% -  -11%) 0.000
      BrowseMonthSSDVFacets       12.43      (7.9%)       10.88      (6.6%)  
-12.4% ( -24% -    2%) 0.000
                   PKLookup      134.94      (1.0%)      118.56      (1.1%)  
-12.1% ( -14% -  -10%) 0.000
                    LowTerm      972.51      (3.9%)      870.89      (2.9%)  
-10.4% ( -16% -   -3%) 0.000
                 AndHighLow     1256.92      (4.3%)     1126.63      (4.2%)  
-10.4% ( -18% -   -1%) 0.000
                   HighTerm      938.27      (4.5%)      843.52      (3.7%)  
-10.1% ( -17% -   -1%) 0.000
              LowTermVector      821.50      (2.4%)      739.43      (1.4%)  
-10.0% ( -13% -   -6%) 0.000
                   Wildcard       94.86      (2.1%)       85.51      (1.9%)   
-9.9% ( -13% -   -6%) 0.000
                  OrHighMed       98.33      (3.0%)       88.70      (3.0%)   
-9.8% ( -15% -   -3%) 0.000
           AndHighLowVector      859.32      (2.2%)      775.74      (1.9%)   
-9.7% ( -13% -   -5%) 0.000
           AndHighMedVector      723.85      (4.0%)      654.44      (3.3%)   
-9.6% ( -16% -   -2%) 0.000
          AndHighHighVector      825.28      (1.7%)      746.88      (1.5%)   
-9.5% ( -12% -   -6%) 0.000
                    MedTerm     1133.18      (4.2%)     1025.84      (2.6%)   
-9.5% ( -15% -   -2%) 0.000
                 AndHighMed      163.82      (4.0%)      148.32      (3.3%)   
-9.5% ( -16% -   -2%) 0.000
              OrNotHighHigh      432.50      (4.6%)      391.92      (3.9%)   
-9.4% ( -17% -    0%) 0.000
              MedTermVector      761.28      (3.9%)      690.36      (3.4%)   
-9.3% ( -15% -   -2%) 0.000
            MedSloppyPhrase       44.77      (2.3%)       40.61      (1.6%)   
-9.3% ( -12% -   -5%) 0.000
              OrHighNotHigh      457.14      (3.9%)      414.97      (5.6%)   
-9.2% ( -17% -    0%) 0.000
             HighTermVector      814.15      (5.0%)      741.66      (5.0%)   
-8.9% ( -18% -    1%) 0.000
                AndHighHigh       34.20      (3.6%)       31.39      (3.5%)   
-8.2% ( -14% -   -1%) 0.000
                  OrHighLow      318.11      (7.2%)      292.68      (4.9%)   
-8.0% ( -18% -    4%) 0.000
               OrNotHighMed      489.33      (4.3%)      451.73      (3.3%)   
-7.7% ( -14% -    0%) 0.000
                  MedPhrase      112.51      (2.1%)      103.95      (2.3%)   
-7.6% ( -11% -   -3%) 0.000
               HighSpanNear        9.46      (3.1%)        8.76      (2.1%)   
-7.4% ( -12% -   -2%) 0.000
            LowSloppyPhrase       98.59      (2.4%)       91.33      (1.3%)   
-7.4% ( -10% -   -3%) 0.000
                MedSpanNear       98.82      (2.6%)       91.64      (2.0%)   
-7.3% ( -11% -   -2%) 0.000
                     Fuzzy1       52.63      (9.9%)       49.02      (5.8%)   
-6.9% ( -20% -    9%) 0.007
                LowSpanNear       93.95      (2.1%)       87.52      (1.6%)   
-6.8% ( -10% -   -3%) 0.000
                 HighPhrase      256.37      (3.7%)      239.54      (2.3%)   
-6.6% ( -12% -    0%) 0.000
                    Prefix3      227.65      (6.2%)      213.30      (5.9%)   
-6.3% ( -17% -    6%) 0.001
           HighSloppyPhrase        9.96      (3.1%)        9.35      (2.2%)   
-6.1% ( -11% -    0%) 0.000
                 OrHighHigh       21.71      (2.6%)       20.54      (1.8%)   
-5.4% (  -9% -   -1%) 0.000
               OrHighNotMed      471.56      (6.3%)      446.92      (4.6%)   
-5.2% ( -15% -    5%) 0.003
               OrHighNotLow      555.62      (4.9%)      526.59      (3.5%)   
-5.2% ( -13% -    3%) 0.000
      HighTermDayOfYearSort       33.02      (9.4%)       31.30      (8.0%)   
-5.2% ( -20% -   13%) 0.058
                  LowPhrase      310.16      (4.3%)      295.71      (2.5%)   
-4.7% ( -11% -    2%) 0.000
       HighIntervalsOrdered       12.32      (1.4%)       11.77      (1.3%)   
-4.5% (  -7% -   -1%) 0.000
          HighTermMonthSort      121.01     (14.0%)      116.57     (11.1%)   
-3.7% ( -25% -   24%) 0.358
   BrowseDayOfYearSSDVFacets        9.72      (6.0%)        9.39      (1.7%)   
-3.3% ( -10% -    4%) 0.017
                 TermDTSort       96.25      (8.7%)       94.99      (8.3%)   
-1.3% ( -16% -   17%) 0.626
       HighTermTitleBDVSort      102.37     (16.1%)      101.51     (16.7%)   
-0.8% ( -28% -   38%) 0.871
                     IntNRQ      203.00      (0.8%)      202.97      (0.7%)   
-0.0% (  -1% -    1%) 0.952
   ```


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org

Reply via email to