gf2121 commented on PR #14910: URL: https://github.com/apache/lucene/pull/14910#issuecomment-3086833501
> there may be a small speedup for some queries but not as much as previously reported. I guess your benchmark runs agains current `main` which includes https://github.com/apache/lucene/pull/14935 while previous report not. The following report is i get on AVX512, so i think your result on AVX2 is expected. ``` TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff p-value OrHighRare 127.60 (6.9%) 124.88 (8.4%) -2.1% ( -16% - 14%) 0.382 Term 483.00 (4.6%) 475.41 (4.9%) -1.6% ( -10% - 8%) 0.296 CombinedAndHighMed 31.34 (2.7%) 30.99 (3.1%) -1.1% ( -6% - 4%) 0.226 TermDTSort 230.76 (3.2%) 229.41 (3.3%) -0.6% ( -6% - 6%) 0.567 DismaxTerm 422.26 (3.1%) 420.12 (3.1%) -0.5% ( -6% - 5%) 0.603 FilteredTerm 72.81 (1.7%) 72.52 (2.0%) -0.4% ( -4% - 3%) 0.505 CountOrHighMed 101.54 (1.1%) 101.15 (1.5%) -0.4% ( -2% - 2%) 0.351 FilteredOrHighHigh 19.23 (1.0%) 19.16 (1.4%) -0.3% ( -2% - 2%) 0.358 AndHighMed 79.76 (2.2%) 79.50 (3.0%) -0.3% ( -5% - 4%) 0.687 AndMedOrHighHigh 24.19 (1.6%) 24.12 (1.9%) -0.3% ( -3% - 3%) 0.578 OrHighMed 97.86 (2.0%) 97.58 (2.6%) -0.3% ( -4% - 4%) 0.688 CountOrHighHigh 68.53 (0.8%) 68.36 (1.1%) -0.2% ( -2% - 1%) 0.422 CombinedTerm 17.09 (2.9%) 17.05 (3.2%) -0.2% ( -6% - 6%) 0.808 CombinedOrHighMed 30.64 (2.2%) 30.57 (3.6%) -0.2% ( -5% - 5%) 0.810 CombinedAndHighHigh 8.45 (2.7%) 8.43 (2.6%) -0.2% ( -5% - 5%) 0.787 FilteredAndHighMed 50.35 (1.3%) 50.26 (1.5%) -0.2% ( -2% - 2%) 0.687 And3Terms 98.50 (3.7%) 98.32 (4.6%) -0.2% ( -8% - 8%) 0.891 FilteredPhrase 14.27 (2.1%) 14.24 (1.9%) -0.2% ( -4% - 3%) 0.791 FilteredOrHighMed 54.69 (1.4%) 54.60 (1.4%) -0.2% ( -2% - 2%) 0.722 CountAndHighHigh 67.35 (0.9%) 67.26 (1.2%) -0.1% ( -2% - 2%) 0.697 Wildcard 56.31 (3.3%) 56.26 (3.3%) -0.1% ( -6% - 6%) 0.924 Fuzzy1 37.10 (2.2%) 37.07 (2.5%) -0.1% ( -4% - 4%) 0.927 CountFilteredOrHighMed 34.07 (0.4%) 34.05 (0.6%) -0.1% ( -1% - 0%) 0.688 Respell 29.69 (2.6%) 29.67 (2.4%) -0.1% ( -4% - 5%) 0.939 CountFilteredOrHighHigh 28.53 (0.5%) 28.52 (0.7%) -0.0% ( -1% - 1%) 0.817 Fuzzy2 33.99 (2.2%) 34.00 (2.4%) 0.0% ( -4% - 4%) 0.985 AndHighOrMedMed 22.20 (2.0%) 22.20 (2.0%) 0.0% ( -3% - 4%) 0.982 CountAndHighMed 96.12 (1.2%) 96.13 (1.4%) 0.0% ( -2% - 2%) 0.967 CountTerm 4947.81 (3.3%) 4949.52 (3.7%) 0.0% ( -6% - 7%) 0.975 DismaxOrHighMed 65.72 (2.0%) 65.78 (2.4%) 0.1% ( -4% - 4%) 0.897 FilteredIntNRQ 60.66 (0.9%) 60.72 (1.2%) 0.1% ( -2% - 2%) 0.791 TermDayOfYearSort 407.35 (2.2%) 407.88 (2.3%) 0.1% ( -4% - 4%) 0.855 CountFilteredIntNRQ 25.92 (0.4%) 25.95 (0.5%) 0.1% ( 0% - 1%) 0.324 FilteredOr3Terms 57.49 (1.2%) 57.60 (1.1%) 0.2% ( -2% - 2%) 0.599 IntNRQ 61.25 (1.0%) 61.39 (1.2%) 0.2% ( -1% - 2%) 0.526 FilteredAndHighHigh 17.66 (1.1%) 17.70 (0.8%) 0.2% ( -1% - 2%) 0.455 FilteredOrStopWords 12.28 (1.8%) 12.31 (1.9%) 0.2% ( -3% - 4%) 0.677 FilteredOr2Terms2StopWords 65.25 (1.1%) 65.43 (1.0%) 0.3% ( -1% - 2%) 0.408 Or3Terms 89.77 (4.0%) 90.03 (4.7%) 0.3% ( -8% - 9%) 0.829 Phrase 10.62 (3.2%) 10.65 (3.3%) 0.3% ( -5% - 7%) 0.753 DismaxOrHighHigh 44.42 (2.5%) 44.57 (2.8%) 0.3% ( -4% - 5%) 0.696 Prefix3 97.90 (3.1%) 98.26 (3.2%) 0.4% ( -5% - 6%) 0.712 FilteredAnd2Terms2StopWords 76.73 (1.7%) 77.03 (2.3%) 0.4% ( -3% - 4%) 0.536 FilteredAndStopWords 14.35 (1.2%) 14.41 (1.0%) 0.4% ( -1% - 2%) 0.209 FilteredAnd3Terms 116.13 (1.1%) 116.65 (1.3%) 0.4% ( -1% - 2%) 0.236 FilteredPrefix3 91.42 (3.0%) 91.84 (2.9%) 0.5% ( -5% - 6%) 0.620 IntSet 167.56 (5.1%) 168.35 (5.0%) 0.5% ( -9% - 11%) 0.767 Or2Terms2StopWords 77.52 (2.5%) 77.94 (3.0%) 0.5% ( -4% - 6%) 0.536 And2Terms2StopWords 73.71 (2.6%) 74.12 (3.0%) 0.6% ( -4% - 6%) 0.536 TermMonthSort 1991.89 (2.0%) 2008.30 (2.8%) 0.8% ( -3% - 5%) 0.281 OrHighHigh 32.79 (4.1%) 33.08 (4.5%) 0.9% ( -7% - 9%) 0.520 CombinedOrHighHigh 8.25 (3.1%) 8.32 (3.2%) 0.9% ( -5% - 7%) 0.360 TermTitleSort 72.91 (1.9%) 73.66 (3.1%) 1.0% ( -3% - 6%) 0.211 CountFilteredPhrase 12.76 (1.6%) 12.91 (1.7%) 1.1% ( -2% - 4%) 0.036 AndHighHigh 32.95 (3.0%) 33.61 (3.9%) 2.0% ( -4% - 9%) 0.067 AndStopWords 12.52 (4.9%) 13.05 (6.1%) 4.2% ( -6% - 15%) 0.015 OrStopWords 13.62 (4.4%) 14.58 (5.4%) 7.1% ( -2% - 17%) 0.000 ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For additional commands, e-mail: issues-h...@lucene.apache.org
