gf2121 commented on PR #13221: URL: https://github.com/apache/lucene/pull/13221#issuecomment-2022926905
I run 10 rounds on wikimediumall index (normal index, no index sorting / force merge). Result looks positive in general, but we do meet slight regression for high-cardinality field in several rounds (3/10). ``` TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff p-value TermDTSort 377.08 (4.3%) 364.56 (5.6%) -3.3% ( -12% - 6%) 0.036 HighTermDayOfYearSort 620.13 (4.1%) 783.98 (7.8%) 26.4% ( 13% - 39%) 0.000 TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff p-value TermDTSort 334.03 (8.0%) 357.86 (5.5%) 7.1% ( -5% - 22%) 0.001 HighTermDayOfYearSort 565.44 (6.3%) 1043.55 (6.3%) 84.6% ( 67% - 103%) 0.000 TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff p-value TermDTSort 434.01 (4.1%) 491.14 (4.3%) 13.2% ( 4% - 22%) 0.000 HighTermDayOfYearSort 606.48 (3.6%) 914.42 (3.3%) 50.8% ( 42% - 59%) 0.000 TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff p-value TermDTSort 467.90 (5.1%) 498.69 (4.5%) 6.6% ( -2% - 17%) 0.000 HighTermDayOfYearSort 784.73 (5.2%) 1015.12 (2.6%) 29.4% ( 20% - 39%) 0.000 TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff p-value TermDTSort 347.23 (4.3%) 319.38 (1.9%) -8.0% ( -13% - -1%) 0.000 HighTermDayOfYearSort 703.03 (3.5%) 962.18 (1.9%) 36.9% ( 30% - 43%) 0.000 TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff p-value TermDTSort 348.83 (6.9%) 380.95 (5.0%) 9.2% ( -2% - 22%) 0.000 HighTermDayOfYearSort 474.03 (5.4%) 1071.19 (6.0%) 126.0% ( 108% - 145%) 0.000 TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff p-value TermDTSort 364.28 (7.6%) 350.49 (7.5%) -3.8% ( -17% - 12%) 0.111 HighTermDayOfYearSort 761.71 (5.8%) 1090.74 (9.0%) 43.2% ( 26% - 61%) 0.000 TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff p-value TermDTSort 351.76 (8.7%) 381.25 (10.4%) 8.4% ( -9% - 30%) 0.006 HighTermDayOfYearSort 599.32 (6.5%) 791.83 (9.2%) 32.1% ( 15% - 51%) 0.000 TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff p-value TermDTSort 313.74 (4.3%) 319.89 (4.7%) 2.0% ( -6% - 11%) 0.168 HighTermDayOfYearSort 642.69 (5.6%) 836.24 (5.0%) 30.1% ( 18% - 43%) 0.000 TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff p-value TermDTSort 421.29 (4.3%) 498.57 (3.2%) 18.3% ( 10% - 27%) 0.000 HighTermDayOfYearSort 544.96 (3.1%) 865.97 (2.2%) 58.9% ( 51% - 66%) 0.000 ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For additional commands, e-mail: issues-h...@lucene.apache.org