gsmiller commented on PR #13568:
URL: https://github.com/apache/lucene/pull/13568#issuecomment-2289239609

   @epotyom just to confirm, are you using `wikimedium10k` or `wikimedium10m`? 
   
   As another check, I reverted out the changes to IndexSearcher and 
DrillSideways/DrillSidewaysQuery (so nothing is actually using CollectorOwner) 
and benchmarked again, which showed no change (seems like an additional 
confirmation that something in the IndexSearcher change is causing the 
regression)
   
   ```
                               TaskQPS baseline      StdDevQPS 
my_modified_version      StdDev                Pct diff p-value
                        AndHighHigh      225.16      (6.1%)      217.69      
(8.5%)   -3.3% ( -16% -   12%) 0.156
          BrowseDayOfYearSSDVFacets       11.17     (18.2%)       10.87     
(13.9%)   -2.7% ( -29% -   35%) 0.601
               BrowseDateSSDVFacets        2.19     (19.4%)        2.13     
(18.8%)   -2.6% ( -34% -   44%) 0.664
                         OrHighHigh      201.22      (5.0%)      198.72      
(4.7%)   -1.2% ( -10% -    8%) 0.417
                       HighSpanNear       37.17      (4.6%)       36.83      
(4.2%)   -0.9% (  -9% -    8%) 0.504
                         AndHighMed      387.99      (4.0%)      384.72      
(3.1%)   -0.8% (  -7% -    6%) 0.461
                        LowSpanNear      156.07      (9.6%)      155.19     
(10.7%)   -0.6% ( -19% -   21%) 0.860
                            Respell       51.44      (8.2%)       51.17      
(8.0%)   -0.5% ( -15% -   17%) 0.841
                  HighTermTitleSort      114.14      (4.2%)      113.96      
(4.5%)   -0.2% (  -8% -    8%) 0.911
               MedTermDayTaxoFacets       25.86      (7.3%)       25.85      
(5.2%)   -0.0% ( -11% -   13%) 0.984
                MedIntervalsOrdered       75.74      (3.4%)       75.78      
(3.6%)    0.1% (  -6% -    7%) 0.960
                        MedSpanNear       68.28      (3.2%)       68.32      
(3.9%)    0.1% (  -6% -    7%) 0.954
                LowIntervalsOrdered      200.45      (3.1%)      200.73      
(3.9%)    0.1% (  -6% -    7%) 0.900
           AndHighHighDayTaxoFacets       25.84      (7.3%)       25.88      
(6.6%)    0.2% ( -12% -   15%) 0.943
              HighTermDayOfYearSort      306.66      (6.9%)      307.52      
(8.4%)    0.3% ( -14% -   16%) 0.908
                         HighPhrase      101.89      (2.9%)      102.33      
(3.6%)    0.4% (  -5% -    7%) 0.672
                       OrNotHighLow     1199.84      (3.8%)     1207.82      
(4.2%)    0.7% (  -7% -    8%) 0.599
                      OrHighNotHigh      295.78      (7.0%)      297.91      
(8.0%)    0.7% ( -13% -   16%) 0.762
                       OrHighNotLow      513.94      (7.2%)      517.70     
(10.4%)    0.7% ( -15% -   19%) 0.796
                          LowPhrase       43.34      (6.0%)       43.69      
(5.8%)    0.8% ( -10% -   13%) 0.664
                          OrHighMed      437.90      (2.8%)      441.57      
(3.2%)    0.8% (  -5% -    7%) 0.379
               HighIntervalsOrdered       46.13      (5.6%)       46.57      
(5.7%)    1.0% (  -9% -   13%) 0.588
                  HighTermMonthSort     1059.70      (4.2%)     1070.83      
(4.6%)    1.1% (  -7% -   10%) 0.452
                          MedPhrase       86.75      (3.5%)       87.71      
(4.4%)    1.1% (  -6% -    9%) 0.373
                           Wildcard      538.29      (5.2%)      544.52      
(6.9%)    1.2% ( -10% -   13%) 0.548
                            MedTerm      584.28      (4.0%)      591.18      
(5.9%)    1.2% (  -8% -   11%) 0.459
                          OrHighLow      477.35      (3.8%)      483.20      
(4.0%)    1.2% (  -6% -    9%) 0.320
                            LowTerm      925.34      (5.1%)      938.49      
(4.5%)    1.4% (  -7% -   11%) 0.353
                           PKLookup      132.45     (10.2%)      134.45     
(12.8%)    1.5% ( -19% -   27%) 0.681
                           HighTerm      420.18      (7.4%)      427.12      
(8.8%)    1.7% ( -13% -   19%) 0.522
                         AndHighLow     1337.71      (5.3%)     1359.97      
(4.9%)    1.7% (  -8% -   12%) 0.302
                       OrNotHighMed      323.46      (4.3%)      329.44      
(5.0%)    1.8% (  -7% -   11%) 0.209
               HighTermTitleBDVSort       15.31     (10.5%)       15.65      
(8.9%)    2.2% ( -15% -   24%) 0.469
                    LowSloppyPhrase      212.91      (2.7%)      217.65      
(2.6%)    2.2% (  -2% -    7%) 0.007
             OrHighMedDayTaxoFacets        7.45      (5.7%)        7.63      
(4.3%)    2.5% (  -7% -   13%) 0.122
                             IntNRQ       80.63      (9.9%)       82.77      
(7.4%)    2.7% ( -13% -   22%) 0.338
            AndHighMedDayTaxoFacets      101.24      (8.0%)      104.11      
(9.2%)    2.8% ( -13% -   21%) 0.299
                    MedSloppyPhrase      105.12      (3.7%)      108.30      
(3.5%)    3.0% (  -3% -   10%) 0.007
                             Fuzzy2       55.64      (8.6%)       57.63      
(8.6%)    3.6% ( -12% -   22%) 0.189
                             Fuzzy1       66.77     (10.6%)       69.30      
(7.4%)    3.8% ( -12% -   24%) 0.189
                      OrNotHighHigh      199.05      (7.7%)      206.60      
(8.0%)    3.8% ( -11% -   21%) 0.127
              BrowseMonthSSDVFacets       11.67     (19.6%)       12.12     
(17.0%)    3.9% ( -27% -   50%) 0.504
                   HighSloppyPhrase       60.07      (5.5%)       62.47      
(5.2%)    4.0% (  -6% -   15%) 0.018
                       OrHighNotMed      413.96      (7.0%)      430.85      
(8.1%)    4.1% ( -10% -   20%) 0.087
        BrowseRandomLabelSSDVFacets        7.80     (11.2%)        8.12     
(10.7%)    4.1% ( -16% -   29%) 0.235
              BrowseMonthTaxoFacets       22.54     (32.7%)       23.94     
(29.4%)    6.2% ( -42% -  101%) 0.528
                         TermDTSort      201.43      (8.9%)      216.02     
(11.6%)    7.2% ( -12% -   30%) 0.026
        BrowseRandomLabelTaxoFacets       14.38     (29.9%)       15.45     
(21.6%)    7.5% ( -33% -   84%) 0.363
                            Prefix3      527.93     (15.0%)      574.70     
(13.1%)    8.9% ( -16% -   43%) 0.047
               BrowseDateTaxoFacets       20.97     (34.9%)       23.04     
(26.8%)    9.9% ( -38% -  109%) 0.316
          BrowseDayOfYearTaxoFacets       21.68     (34.2%)       23.85     
(26.5%)   10.0% ( -37% -  107%) 0.301
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org

Reply via email to