jpountz commented on PR #12457: URL: https://github.com/apache/lucene/pull/12457#issuecomment-1647837090
luceneutil doesn't show an improvement on wikimedium because all fuzzy queries only have low-frequency terms, only nightlies have the `titel~2` query in their tasks file. ``` TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff p-value BrowseMonthTaxoFacets 29.30 (11.3%) 28.48 (8.5%) -2.8% ( -20% - 19%) 0.379 HighTermTitleSort 124.71 (4.8%) 123.46 (3.6%) -1.0% ( -9% - 7%) 0.458 BrowseRandomLabelSSDVFacets 15.12 (7.1%) 14.97 (6.2%) -1.0% ( -13% - 13%) 0.645 AndHighMedDayTaxoFacets 57.93 (2.7%) 57.39 (2.5%) -0.9% ( -5% - 4%) 0.253 OrNotHighMed 464.66 (3.9%) 460.65 (4.8%) -0.9% ( -9% - 8%) 0.535 Wildcard 146.27 (3.1%) 145.06 (3.2%) -0.8% ( -6% - 5%) 0.401 TermDTSort 129.60 (3.1%) 128.54 (3.0%) -0.8% ( -6% - 5%) 0.394 HighTermTitleBDVSort 21.80 (2.5%) 21.62 (5.3%) -0.8% ( -8% - 7%) 0.553 LowSpanNear 153.09 (2.6%) 152.04 (2.5%) -0.7% ( -5% - 4%) 0.396 Prefix3 390.64 (3.6%) 388.59 (1.9%) -0.5% ( -5% - 5%) 0.567 OrHighHigh 62.16 (8.4%) 61.84 (8.7%) -0.5% ( -16% - 18%) 0.846 OrHighMed 220.25 (4.1%) 219.29 (4.1%) -0.4% ( -8% - 8%) 0.738 LowIntervalsOrdered 40.49 (3.4%) 40.32 (3.5%) -0.4% ( -7% - 6%) 0.696 BrowseDayOfYearTaxoFacets 43.88 (3.6%) 43.73 (3.9%) -0.3% ( -7% - 7%) 0.771 MedTermDayTaxoFacets 52.83 (5.9%) 52.66 (5.9%) -0.3% ( -11% - 12%) 0.869 Respell 93.33 (1.9%) 93.07 (2.0%) -0.3% ( -4% - 3%) 0.650 HighTermDayOfYearSort 433.75 (1.6%) 432.55 (2.0%) -0.3% ( -3% - 3%) 0.628 HighTermMonthSort 3538.92 (6.8%) 3530.16 (6.7%) -0.2% ( -12% - 14%) 0.907 IntNRQ 102.12 (3.6%) 101.90 (3.3%) -0.2% ( -6% - 7%) 0.847 MedSpanNear 23.98 (2.3%) 23.93 (2.6%) -0.2% ( -4% - 4%) 0.803 OrNotHighHigh 264.31 (6.4%) 263.92 (7.2%) -0.1% ( -12% - 14%) 0.945 BrowseDateSSDVFacets 5.52 (10.4%) 5.51 (11.2%) -0.1% ( -19% - 24%) 0.974 BrowseDateTaxoFacets 43.24 (3.3%) 43.20 (3.5%) -0.1% ( -6% - 7%) 0.939 MedPhrase 54.46 (3.4%) 54.42 (2.9%) -0.1% ( -6% - 6%) 0.944 BrowseDayOfYearSSDVFacets 19.64 (1.1%) 19.62 (0.8%) -0.1% ( -1% - 1%) 0.831 BrowseMonthSSDVFacets 20.56 (1.2%) 20.55 (0.9%) -0.1% ( -2% - 2%) 0.866 OrHighNotHigh 311.04 (8.5%) 310.95 (8.3%) -0.0% ( -15% - 18%) 0.992 HighSpanNear 8.10 (1.8%) 8.10 (1.7%) 0.0% ( -3% - 3%) 0.967 BrowseRandomLabelTaxoFacets 35.75 (6.3%) 35.76 (4.6%) 0.0% ( -10% - 11%) 0.989 PKLookup 244.39 (4.7%) 244.45 (4.2%) 0.0% ( -8% - 9%) 0.985 AndHighLow 1465.92 (3.5%) 1466.46 (3.1%) 0.0% ( -6% - 6%) 0.972 OrHighNotMed 320.95 (8.3%) 321.07 (8.3%) 0.0% ( -15% - 18%) 0.988 LowPhrase 132.89 (3.5%) 132.95 (2.6%) 0.0% ( -5% - 6%) 0.963 OrHighMedDayTaxoFacets 21.37 (3.8%) 21.39 (4.1%) 0.1% ( -7% - 8%) 0.938 Fuzzy1 100.84 (1.5%) 100.95 (1.2%) 0.1% ( -2% - 2%) 0.792 OrNotHighLow 1042.33 (3.1%) 1043.60 (3.4%) 0.1% ( -6% - 6%) 0.905 LowTerm 828.80 (4.3%) 829.84 (5.3%) 0.1% ( -9% - 10%) 0.934 OrHighLow 212.39 (8.2%) 212.67 (8.3%) 0.1% ( -15% - 18%) 0.959 Fuzzy2 99.83 (1.4%) 99.98 (1.2%) 0.1% ( -2% - 2%) 0.717 MedIntervalsOrdered 34.08 (4.1%) 34.21 (4.6%) 0.4% ( -8% - 9%) 0.786 AndHighHighDayTaxoFacets 19.17 (4.5%) 19.25 (4.1%) 0.4% ( -7% - 9%) 0.751 OrHighNotLow 373.64 (9.3%) 375.42 (8.8%) 0.5% ( -16% - 20%) 0.867 HighTerm 438.65 (7.5%) 441.28 (8.3%) 0.6% ( -14% - 17%) 0.810 LowSloppyPhrase 10.02 (3.4%) 10.08 (4.0%) 0.6% ( -6% - 8%) 0.593 MedSloppyPhrase 57.57 (4.3%) 57.97 (4.5%) 0.7% ( -7% - 9%) 0.621 HighIntervalsOrdered 1.78 (5.8%) 1.79 (5.2%) 0.7% ( -9% - 12%) 0.688 MedTerm 591.58 (5.2%) 596.10 (6.6%) 0.8% ( -10% - 13%) 0.685 AndHighMed 268.25 (4.3%) 270.42 (5.5%) 0.8% ( -8% - 11%) 0.606 HighPhrase 6.69 (6.3%) 6.75 (4.8%) 0.9% ( -9% - 12%) 0.625 HighSloppyPhrase 35.67 (5.0%) 36.07 (3.7%) 1.1% ( -7% - 10%) 0.423 AndHighHigh 72.71 (3.9%) 73.74 (5.0%) 1.4% ( -7% - 10%) 0.320 ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For additional commands, e-mail: issues-h...@lucene.apache.org