jpountz commented on PR #14017:
URL: https://github.com/apache/lucene/pull/14017#issuecomment-2497337140

   With Combined tasks in the file (call is 3-polymorphic in the baseline, 
bimorphic in the modified version):
   
   ```
                               TaskQPS baseline      StdDevQPS 
my_modified_version      StdDev                Pct diff p-value
                           PKLookup      277.89      (2.3%)      274.07      
(2.6%)   -1.4% (  -6% -    3%) 0.079
                FilteredOrStopWords       33.44      (2.3%)       33.42      
(1.9%)   -0.1% (  -4% -    4%) 0.935
               FilteredAndStopWords       48.48      (2.6%)       48.48      
(1.8%)   -0.0% (  -4% -    4%) 0.994
        FilteredAnd2Terms2StopWords      195.64      (1.8%)      195.89      
(1.4%)    0.1% (  -3% -    3%) 0.806
                FilteredAndHighHigh       62.16      (2.2%)       62.25      
(1.7%)    0.1% (  -3% -    4%) 0.813
                     FilteredPhrase       25.15      (2.7%)       25.22      
(2.5%)    0.3% (  -4% -    5%) 0.720
                             OrMany       18.96      (4.5%)       19.02      
(5.6%)    0.3% (  -9% -   10%) 0.853
                   FilteredOr3Terms      149.27      (2.0%)      149.75      
(1.6%)    0.3% (  -3% -    4%) 0.574
                       CombinedTerm       34.03      (2.8%)       34.17      
(2.2%)    0.4% (  -4% -    5%) 0.623
                 FilteredOrHighHigh       52.50      (2.3%)       52.71      
(1.8%)    0.4% (  -3% -    4%) 0.531
                  FilteredOrHighMed      114.91      (2.3%)      115.46      
(1.7%)    0.5% (  -3% -    4%) 0.465
                     FilteredOrMany        9.91      (2.8%)        9.96      
(3.4%)    0.6% (  -5% -    6%) 0.572
                  FilteredAnd3Terms      189.21      (1.8%)      190.35      
(1.6%)    0.6% (  -2% -    4%) 0.257
         FilteredOr2Terms2StopWords      109.76      (1.6%)      110.43      
(1.2%)    0.6% (  -2% -    3%) 0.169
                       FilteredTerm      159.61      (2.9%)      160.69      
(2.2%)    0.7% (  -4% -    5%) 0.401
                CombinedAndHighHigh       15.58      (1.0%)       15.81      
(0.8%)    1.5% (   0% -    3%) 0.000
                 CombinedAndHighMed       57.04      (1.3%)       57.92      
(0.8%)    1.5% (   0% -    3%) 0.000
                 FilteredAndHighMed      123.14      (2.9%)      125.29      
(3.0%)    1.8% (  -4% -    7%) 0.060
                          And3Terms      162.00      (4.3%)      167.29      
(4.5%)    3.3% (  -5% -   12%) 0.019
                And2Terms2StopWords      152.25      (4.1%)      158.02      
(4.2%)    3.8% (  -4% -   12%) 0.004
                  CombinedOrHighMed       74.69      (0.7%)       78.15      
(2.3%)    4.6% (   1% -    7%) 0.000
                 CombinedOrHighHigh       19.55      (0.7%)       20.60      
(2.5%)    5.4% (   2% -    8%) 0.000
                         AndHighMed      116.33      (4.0%)      122.79      
(1.5%)    5.6% (   0% -   11%) 0.000
                        AndHighHigh       39.43      (4.2%)       41.74      
(1.9%)    5.9% (   0% -   12%) 0.000
                       AndStopWords       27.82      (5.9%)       29.51      
(6.7%)    6.1% (  -6% -   19%) 0.002
                         OrHighRare      265.91      (7.3%)      284.27      
(5.1%)    6.9% (  -5% -   20%) 0.000
                           Or3Terms      155.29      (3.8%)      168.35      
(5.7%)    8.4% (  -1% -   18%) 0.000
                 Or2Terms2StopWords      146.73      (3.2%)      160.57      
(5.7%)    9.4% (   0% -   18%) 0.000
                        OrStopWords       28.40      (5.6%)       32.31      
(9.5%)   13.8% (  -1% -   30%) 0.000
                          OrHighMed      168.44      (3.9%)      197.35      
(1.6%)   17.2% (  11% -   23%) 0.000
                         OrHighHigh       44.17      (4.6%)       53.19      
(1.7%)   20.4% (  13% -   28%) 0.000
   ```
   
   Without combined tasks in the file (call is bimorphic in the baseline, 
monomorphic in the modified version):
   
   ```
                               TaskQPS baseline      StdDevQPS 
my_modified_version      StdDev                Pct diff p-value
                FilteredOrStopWords       33.95      (1.7%)       33.73      
(1.8%)   -0.7% (  -4% -    2%) 0.245
                     FilteredOrMany       10.23      (2.7%)       10.22      
(2.9%)   -0.1% (  -5% -    5%) 0.928
                 FilteredOrHighHigh       53.10      (1.9%)       53.11      
(2.0%)    0.0% (  -3% -    3%) 0.962
                   FilteredOr3Terms      150.83      (2.0%)      150.98      
(2.3%)    0.1% (  -4% -    4%) 0.879
                  FilteredOrHighMed      116.00      (2.0%)      116.30      
(2.1%)    0.3% (  -3% -    4%) 0.690
                       FilteredTerm      161.02      (2.7%)      161.57      
(2.3%)    0.3% (  -4% -    5%) 0.668
         FilteredOr2Terms2StopWords      110.97      (1.3%)      111.36      
(1.3%)    0.4% (  -2% -    3%) 0.399
                     FilteredPhrase       25.49      (3.3%)       25.59      
(2.8%)    0.4% (  -5% -    6%) 0.693
                          OrHighMed      195.25      (2.5%)      196.56      
(1.9%)    0.7% (  -3% -    5%) 0.336
                         OrHighHigh       52.92      (2.6%)       53.32      
(2.2%)    0.7% (  -3% -    5%) 0.323
                 Or2Terms2StopWords      165.87      (3.3%)      167.13      
(3.3%)    0.8% (  -5% -    7%) 0.471
                           Or3Terms      177.06      (3.5%)      178.44      
(3.5%)    0.8% (  -6% -    8%) 0.484
                        OrStopWords       34.25      (5.2%)       34.64      
(5.2%)    1.1% (  -8% -   12%) 0.492
                           PKLookup      274.02      (1.4%)      277.21      
(1.4%)    1.2% (  -1% -    4%) 0.009
                         OrHighRare      282.75      (6.6%)      286.27      
(6.9%)    1.2% ( -11% -   15%) 0.559
                And2Terms2StopWords      167.40      (3.0%)      170.65      
(3.6%)    1.9% (  -4% -    8%) 0.064
                             OrMany       19.64      (4.0%)       20.22      
(3.7%)    2.9% (  -4% -   11%) 0.017
                         AndHighMed      131.41      (1.8%)      135.53      
(1.8%)    3.1% (   0% -    6%) 0.000
                        AndHighHigh       44.99      (1.9%)       46.55      
(2.2%)    3.5% (   0% -    7%) 0.000
               FilteredAndStopWords       50.36      (2.8%)       52.27      
(1.9%)    3.8% (   0% -    8%) 0.000
        FilteredAnd2Terms2StopWords      202.89      (2.1%)      210.87      
(1.5%)    3.9% (   0% -    7%) 0.000
                       AndStopWords       32.04      (4.8%)       33.33      
(5.9%)    4.0% (  -6% -   15%) 0.018
                          And3Terms      178.11      (3.8%)      185.46      
(4.2%)    4.1% (  -3% -   12%) 0.001
                FilteredAndHighHigh       65.05      (2.8%)       68.05      
(1.9%)    4.6% (   0% -    9%) 0.000
                 FilteredAndHighMed      132.31      (3.0%)      139.26      
(3.0%)    5.2% (   0% -   11%) 0.000
                  FilteredAnd3Terms      195.92      (1.8%)      209.14      
(1.8%)    6.7% (   3% -   10%) 0.000
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org

Reply via email to