gf2121 commented on PR #13221:
URL: https://github.com/apache/lucene/pull/13221#issuecomment-2022926905

   I run 10 rounds on wikimediumall index (normal index, no index sorting / 
force merge). Result looks positive in general, but we do meet slight 
regression for high-cardinality field in several rounds (3/10).
   
   ```
                               TaskQPS baseline      StdDevQPS 
my_modified_version      StdDev                Pct diff p-value
                         TermDTSort      377.08      (4.3%)      364.56      
(5.6%)   -3.3% ( -12% -    6%) 0.036
              HighTermDayOfYearSort      620.13      (4.1%)      783.98      
(7.8%)   26.4% (  13% -   39%) 0.000
              
                               TaskQPS baseline      StdDevQPS 
my_modified_version      StdDev                Pct diff p-value
                         TermDTSort      334.03      (8.0%)      357.86      
(5.5%)    7.1% (  -5% -   22%) 0.001
              HighTermDayOfYearSort      565.44      (6.3%)     1043.55      
(6.3%)   84.6% (  67% -  103%) 0.000
              
                               TaskQPS baseline      StdDevQPS 
my_modified_version      StdDev                Pct diff p-value
                         TermDTSort      434.01      (4.1%)      491.14      
(4.3%)   13.2% (   4% -   22%) 0.000
              HighTermDayOfYearSort      606.48      (3.6%)      914.42      
(3.3%)   50.8% (  42% -   59%) 0.000
              
                               TaskQPS baseline      StdDevQPS 
my_modified_version      StdDev                Pct diff p-value
                         TermDTSort      467.90      (5.1%)      498.69      
(4.5%)    6.6% (  -2% -   17%) 0.000
              HighTermDayOfYearSort      784.73      (5.2%)     1015.12      
(2.6%)   29.4% (  20% -   39%) 0.000
              
                               TaskQPS baseline      StdDevQPS 
my_modified_version      StdDev                Pct diff p-value
                         TermDTSort      347.23      (4.3%)      319.38      
(1.9%)   -8.0% ( -13% -   -1%) 0.000
              HighTermDayOfYearSort      703.03      (3.5%)      962.18      
(1.9%)   36.9% (  30% -   43%) 0.000
              
                               TaskQPS baseline      StdDevQPS 
my_modified_version      StdDev                Pct diff p-value
                         TermDTSort      348.83      (6.9%)      380.95      
(5.0%)    9.2% (  -2% -   22%) 0.000
              HighTermDayOfYearSort      474.03      (5.4%)     1071.19      
(6.0%)  126.0% ( 108% -  145%) 0.000
              
                               TaskQPS baseline      StdDevQPS 
my_modified_version      StdDev                Pct diff p-value
                         TermDTSort      364.28      (7.6%)      350.49      
(7.5%)   -3.8% ( -17% -   12%) 0.111
              HighTermDayOfYearSort      761.71      (5.8%)     1090.74      
(9.0%)   43.2% (  26% -   61%) 0.000
              
                               TaskQPS baseline      StdDevQPS 
my_modified_version      StdDev                Pct diff p-value
                         TermDTSort      351.76      (8.7%)      381.25     
(10.4%)    8.4% (  -9% -   30%) 0.006
              HighTermDayOfYearSort      599.32      (6.5%)      791.83      
(9.2%)   32.1% (  15% -   51%) 0.000
              
                               TaskQPS baseline      StdDevQPS 
my_modified_version      StdDev                Pct diff p-value
                         TermDTSort      313.74      (4.3%)      319.89      
(4.7%)    2.0% (  -6% -   11%) 0.168
              HighTermDayOfYearSort      642.69      (5.6%)      836.24      
(5.0%)   30.1% (  18% -   43%) 0.000
              
                               TaskQPS baseline      StdDevQPS 
my_modified_version      StdDev                Pct diff p-value
                         TermDTSort      421.29      (4.3%)      498.57      
(3.2%)   18.3% (  10% -   27%) 0.000
              HighTermDayOfYearSort      544.96      (3.1%)      865.97      
(2.2%)   58.9% (  51% -   66%) 0.000
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org

Reply via email to