gsmiller commented on PR #13656:
URL: https://github.com/apache/lucene/pull/13656#issuecomment-2289330332

   Also, benchmarks (wikimedium10m) comparing this PR to the tip of main seems 
to indicate it reverses the performance impact we observed in the nightly runs:
   ```
                               TaskQPS baseline      StdDevQPS 
my_modified_version      StdDev                Pct diff p-value
                       OrHighNotMed      514.50      (7.8%)      450.63      
(8.0%)  -12.4% ( -26% -    3%) 0.000
          BrowseDayOfYearSSDVFacets       12.31     (17.6%)       11.25     
(14.8%)   -8.7% ( -34% -   28%) 0.093
                      OrHighNotHigh      736.67      (5.7%)      681.57      
(5.8%)   -7.5% ( -17% -    4%) 0.000
                       OrHighNotLow      540.78      (8.0%)      501.87      
(5.7%)   -7.2% ( -19% -    7%) 0.001
                             Fuzzy2       62.59      (9.4%)       61.15      
(6.3%)   -2.3% ( -16% -   14%) 0.362
               BrowseDateSSDVFacets        2.28     (18.0%)        2.23     
(20.5%)   -2.2% ( -34% -   44%) 0.720
                           PKLookup      138.88      (9.4%)      135.97      
(9.0%)   -2.1% ( -18% -   18%) 0.471
            AndHighMedDayTaxoFacets       94.46      (7.4%)       92.84      
(8.5%)   -1.7% ( -16% -   15%) 0.495
                         TermDTSort      201.98      (9.6%)      198.97      
(7.3%)   -1.5% ( -16% -   17%) 0.581
                         AndHighLow     1481.23      (4.9%)     1461.85      
(5.2%)   -1.3% ( -10% -    9%) 0.414
                         HighPhrase      133.81      (5.5%)      132.64      
(5.2%)   -0.9% ( -11% -   10%) 0.607
                          LowPhrase      144.74      (3.7%)      143.77      
(2.5%)   -0.7% (  -6% -    5%) 0.501
                        LowSpanNear      176.09      (3.2%)      174.97      
(2.4%)   -0.6% (  -6% -    5%) 0.480
                       OrNotHighMed      316.14      (7.1%)      314.30      
(6.9%)   -0.6% ( -13% -   14%) 0.794
        BrowseRandomLabelTaxoFacets       15.74     (22.4%)       15.66     
(21.3%)   -0.5% ( -36% -   55%) 0.939
                  HighTermTitleSort      103.22      (7.7%)      102.82      
(6.9%)   -0.4% ( -13% -   15%) 0.867
                      OrNotHighHigh      273.54      (7.2%)      272.64      
(5.2%)   -0.3% ( -11% -   12%) 0.868
           AndHighHighDayTaxoFacets       18.05      (7.7%)       18.05      
(7.4%)    0.0% ( -13% -   16%) 0.996
              HighTermDayOfYearSort      336.99     (11.2%)      338.19      
(8.7%)    0.4% ( -17% -   22%) 0.910
                          MedPhrase       54.51      (9.5%)       54.91      
(8.2%)    0.7% ( -15% -   20%) 0.795
                MedIntervalsOrdered       19.45      (4.2%)       19.60      
(5.0%)    0.7% (  -8% -   10%) 0.616
                    MedSloppyPhrase      108.50      (5.2%)      109.33      
(5.6%)    0.8% (  -9% -   12%) 0.653
               BrowseDateTaxoFacets       23.33     (24.9%)       23.52     
(25.2%)    0.8% ( -39% -   67%) 0.916
                           Wildcard      506.91      (4.2%)      511.80      
(5.6%)    1.0% (  -8% -   11%) 0.539
                         AndHighMed      428.85      (4.2%)      433.08      
(4.0%)    1.0% (  -6% -    9%) 0.448
              BrowseMonthTaxoFacets       24.39     (25.2%)       24.67     
(25.8%)    1.1% ( -39% -   69%) 0.887
                  HighTermMonthSort     1073.70      (3.8%)     1087.16      
(4.9%)    1.3% (  -7% -   10%) 0.364
             OrHighMedDayTaxoFacets       10.65      (6.4%)       10.79      
(6.1%)    1.3% ( -10% -   14%) 0.524
                       OrNotHighLow     1218.33      (4.8%)     1235.66      
(2.9%)    1.4% (  -5% -    9%) 0.252
               MedTermDayTaxoFacets       33.99      (6.8%)       34.48      
(7.7%)    1.4% ( -12% -   17%) 0.528
          BrowseDayOfYearTaxoFacets       23.89     (25.2%)       24.28     
(24.7%)    1.6% ( -38% -   69%) 0.837
                        AndHighHigh      165.85      (8.0%)      169.19      
(7.1%)    2.0% ( -12% -   18%) 0.400
                            Respell       44.10      (7.4%)       45.01      
(7.6%)    2.1% ( -12% -   18%) 0.384
                LowIntervalsOrdered       66.23      (6.0%)       67.61      
(8.2%)    2.1% ( -11% -   17%) 0.364
                          OrHighLow      420.34      (6.2%)      429.68      
(6.4%)    2.2% (  -9% -   15%) 0.265
               HighTermTitleBDVSort       45.89      (7.9%)       47.02      
(7.1%)    2.5% ( -11% -   19%) 0.303
                             Fuzzy1       64.64      (7.6%)       66.39      
(8.9%)    2.7% ( -12% -   20%) 0.300
                          OrHighMed      384.44      (3.6%)      395.46      
(3.2%)    2.9% (  -3% -   10%) 0.008
                         OrHighHigh      194.21      (7.1%)      199.80      
(7.3%)    2.9% ( -10% -   18%) 0.206
                       HighSpanNear       58.20      (2.9%)       59.91      
(3.6%)    2.9% (  -3% -    9%) 0.004
              BrowseMonthSSDVFacets       11.00     (10.9%)       11.36     
(13.7%)    3.2% ( -19% -   31%) 0.412
                   HighSloppyPhrase       16.33      (6.5%)       16.88      
(7.3%)    3.3% (  -9% -   18%) 0.128
                            Prefix3      492.96     (16.6%)      509.78     
(11.3%)    3.4% ( -21% -   37%) 0.448
                        MedSpanNear       97.89      (3.1%)      101.67      
(4.2%)    3.9% (  -3% -   11%) 0.001
               HighIntervalsOrdered       46.46     (10.2%)       48.54      
(8.6%)    4.5% ( -12% -   25%) 0.134
        BrowseRandomLabelSSDVFacets        7.45      (9.0%)        7.79     
(13.4%)    4.6% ( -16% -   29%) 0.205
                    LowSloppyPhrase      172.46     (18.1%)      181.88     
(13.7%)    5.5% ( -22% -   45%) 0.281
                             IntNRQ      164.75     (20.3%)      178.95     
(22.5%)    8.6% ( -28% -   64%) 0.203
                            LowTerm      712.28      (4.9%)      795.97      
(6.7%)   11.7% (   0% -   24%) 0.000
                            MedTerm      441.32      (5.1%)      575.99     
(10.0%)   30.5% (  14% -   48%) 0.000
                           HighTerm      387.23     (10.4%)      522.80     
(10.3%)   35.0% (  12% -   62%) 0.000
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org

Reply via email to