gf2121 commented on PR #14910:
URL: https://github.com/apache/lucene/pull/14910#issuecomment-3058170259

   Some more data:
   
   **Mac M2**
   
   ```
                               TaskQPS baseline      StdDevQPS 
my_modified_version      StdDev                Pct diff p-value
                          CountTerm    12276.27     (12.1%)    11998.30      
(7.3%)   -2.3% ( -19% -   19%) 0.563
                      TermMonthSort     4162.59      (8.8%)     4111.81      
(3.4%)   -1.2% ( -12% -   12%) 0.641
                   CountAndHighHigh       84.34      (2.6%)       83.54      
(2.5%)   -0.9% (  -5% -    4%) 0.342
             CountFilteredOrHighMed       48.75      (4.9%)       48.31      
(3.8%)   -0.9% (  -9% -    8%) 0.591
            CountFilteredOrHighHigh       39.65      (4.2%)       39.30      
(3.2%)   -0.9% (  -7% -    6%) 0.543
   
                                                       ...
   
                         OrHighHigh       48.67     (12.7%)       52.67      
(2.7%)    8.2% (  -6% -   27%) 0.023
                       AndStopWords       16.25      (9.7%)       17.63      
(4.3%)    8.5% (  -5% -   24%) 0.004
                        AndHighHigh       50.29     (13.5%)       55.32      
(2.5%)   10.0% (  -5% -   30%) 0.009
                        OrStopWords       18.18     (10.6%)       20.61      
(3.1%)   13.4% (   0% -   30%) 0.000
   ```
   
   **AVX512 (mentioned above)**
   ```
   TaskQPS baseline      StdDevQPS my_modified_version      StdDev              
  Pct diff p-value
                    FilteredPrefix3       76.86      (3.2%)       76.20      
(5.5%)   -0.9% (  -9% -    8%) 0.552
                            Prefix3       81.74      (3.1%)       81.13      
(4.9%)   -0.7% (  -8% -    7%) 0.567
                   AndMedOrHighHigh       22.83      (1.8%)       22.78      
(2.0%)   -0.3% (  -3% -    3%) 0.670
                      TermMonthSort     1184.75      (2.7%)     1182.73      
(8.4%)   -0.2% ( -10% -   11%) 0.931
                 CombinedOrHighHigh        7.95      (2.8%)        7.94      
(2.7%)   -0.2% (  -5% -    5%) 0.844
                And2Terms2StopWords       66.71      (2.5%)       66.61      
(4.6%)   -0.1% (  -7% -    7%) 0.903
   
                                                       ...
    
                          CountTerm     2847.75      (5.6%)     2897.40      
(8.8%)    1.7% ( -11% -   17%) 0.454
                         OrHighHigh       29.50      (2.0%)       30.17      
(2.9%)    2.3% (  -2% -    7%) 0.004
                             IntSet      150.21      (4.2%)      154.28      
(4.6%)    2.7% (  -5% -   11%) 0.051
                        AndHighHigh       30.04      (1.9%)       31.63      
(3.1%)    5.3% (   0% -   10%) 0.000
                       AndStopWords       10.60      (1.9%)       11.83      
(2.0%)   11.6% (   7% -   15%) 0.000
                        OrStopWords       11.41      (2.8%)       13.26      
(3.0%)   16.2% (  10% -   22%) 0.000
   ```
   
   **same AVX512 machine without `--add-modules=jdk.incubator.vector`**
   ```
                               TaskQPS baseline      StdDevQPS 
my_modified_version      StdDev                Pct diff p-value
                    FilteredPrefix3       74.47      (3.7%)       73.32      
(4.0%)   -1.5% (  -8% -    6%) 0.210
                            Prefix3       79.35      (3.9%)       78.23      
(3.5%)   -1.4% (  -8% -    6%) 0.232
                          CountTerm     2921.10      (6.2%)     2897.44      
(7.5%)   -0.8% ( -13% -   13%) 0.708
                And2Terms2StopWords       62.09      (1.7%)       61.80      
(2.6%)   -0.5% (  -4% -    3%) 0.482
   
                                                       ...
    
                         OrHighHigh       27.33      (2.4%)       27.66      
(2.0%)    1.2% (  -3% -    5%) 0.092
                         OrHighRare      116.98      (3.3%)      118.89      
(2.7%)    1.6% (  -4% -    7%) 0.088
                        AndHighHigh       27.52      (2.0%)       28.02      
(1.5%)    1.8% (  -1% -    5%) 0.001
                       AndStopWords       10.60      (3.0%)       11.01      
(1.7%)    3.8% (   0% -    8%) 0.000
                        OrStopWords       11.26      (3.6%)       11.97      
(2.2%)    6.3% (   0% -   12%) 0.000
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org

Reply via email to