mdmarshmallow commented on PR #12194: URL: https://github.com/apache/lucene/pull/12194#issuecomment-1470400045
I tested with wikimedium10m. Looks like my change caused the `Prefix3` test to slow down.. not sure why. ``` TaskQPS baseline StdDevQPS my_modified_version StdDev Pct diff p-value Prefix3 116.79 (1.7%) 101.89 (1.2%) -12.8% ( -15% - -10%) 0.000 OrNotHighMed 270.50 (3.5%) 254.28 (2.8%) -6.0% ( -11% - 0%) 0.000 OrHighNotHigh 173.22 (3.7%) 162.94 (3.3%) -5.9% ( -12% - 1%) 0.000 OrNotHighHigh 304.62 (4.0%) 287.18 (2.4%) -5.7% ( -11% - 0%) 0.000 OrHighNotMed 269.23 (4.3%) 257.83 (3.6%) -4.2% ( -11% - 3%) 0.001 Wildcard 411.95 (2.3%) 395.75 (1.9%) -3.9% ( -7% - 0%) 0.000 OrHighNotLow 391.63 (4.5%) 378.58 (3.8%) -3.3% ( -11% - 5%) 0.012 HighTermTitleBDVSort 14.56 (7.8%) 14.14 (6.1%) -2.9% ( -15% - 12%) 0.199 OrHighHigh 25.14 (3.3%) 24.68 (4.3%) -1.8% ( -9% - 5%) 0.131 OrHighMed 104.03 (2.8%) 102.70 (4.3%) -1.3% ( -8% - 6%) 0.267 MedIntervalsOrdered 11.84 (4.4%) 11.72 (3.8%) -1.0% ( -8% - 7%) 0.417 OrHighLow 395.96 (1.9%) 391.83 (2.0%) -1.0% ( -4% - 2%) 0.097 HighIntervalsOrdered 19.10 (3.9%) 18.95 (4.1%) -0.8% ( -8% - 7%) 0.541 AndHighMedDayTaxoFacets 112.90 (1.8%) 112.13 (2.2%) -0.7% ( -4% - 3%) 0.275 AndHighHigh 62.08 (3.5%) 61.72 (4.8%) -0.6% ( -8% - 8%) 0.666 OrNotHighLow 875.73 (3.2%) 871.01 (3.3%) -0.5% ( -6% - 6%) 0.599 LowSloppyPhrase 5.77 (2.3%) 5.74 (3.0%) -0.5% ( -5% - 4%) 0.536 LowIntervalsOrdered 46.88 (2.6%) 46.63 (2.7%) -0.5% ( -5% - 4%) 0.540 MedSloppyPhrase 10.85 (2.1%) 10.80 (2.7%) -0.5% ( -5% - 4%) 0.514 MedSpanNear 13.61 (3.4%) 13.55 (3.5%) -0.4% ( -7% - 6%) 0.681 HighSloppyPhrase 22.71 (3.6%) 22.64 (4.4%) -0.3% ( -8% - 7%) 0.789 HighTerm 279.23 (5.2%) 278.37 (3.9%) -0.3% ( -8% - 9%) 0.832 OrHighMedDayTaxoFacets 4.67 (3.9%) 4.65 (3.6%) -0.3% ( -7% - 7%) 0.809 AndHighLow 826.71 (2.5%) 824.54 (2.5%) -0.3% ( -5% - 4%) 0.740 PKLookup 143.32 (3.6%) 143.00 (3.2%) -0.2% ( -6% - 6%) 0.837 LowPhrase 138.92 (1.7%) 138.73 (2.2%) -0.1% ( -4% - 3%) 0.828 LowTerm 436.79 (2.7%) 436.39 (3.7%) -0.1% ( -6% - 6%) 0.929 AndHighMed 165.94 (3.4%) 165.82 (4.3%) -0.1% ( -7% - 7%) 0.953 HighPhrase 75.52 (2.1%) 75.47 (2.1%) -0.1% ( -4% - 4%) 0.921 MedTermDayTaxoFacets 23.58 (4.0%) 23.57 (3.2%) -0.0% ( -7% - 7%) 0.979 HighSpanNear 23.96 (2.5%) 23.96 (2.8%) 0.0% ( -5% - 5%) 0.998 Fuzzy2 38.68 (1.7%) 38.69 (2.5%) 0.0% ( -4% - 4%) 0.992 AndHighHighDayTaxoFacets 13.62 (1.8%) 13.63 (1.7%) 0.1% ( -3% - 3%) 0.903 BrowseMonthSSDVFacets 10.96 (1.2%) 10.97 (1.0%) 0.1% ( -2% - 2%) 0.766 Respell 49.97 (1.4%) 50.04 (1.6%) 0.1% ( -2% - 3%) 0.769 MedTerm 368.29 (4.8%) 369.09 (4.6%) 0.2% ( -8% - 10%) 0.884 MedPhrase 54.77 (3.6%) 54.94 (3.5%) 0.3% ( -6% - 7%) 0.778 HighTermDayOfYearSort 299.85 (2.2%) 300.91 (1.9%) 0.4% ( -3% - 4%) 0.590 BrowseRandomLabelSSDVFacets 6.81 (5.8%) 6.83 (6.9%) 0.4% ( -11% - 13%) 0.862 IntNRQ 357.58 (6.6%) 358.90 (7.3%) 0.4% ( -12% - 15%) 0.867 LowSpanNear 191.59 (1.8%) 192.64 (1.9%) 0.5% ( -3% - 4%) 0.347 HighTermTitleSort 54.66 (2.5%) 55.03 (3.8%) 0.7% ( -5% - 7%) 0.502 BrowseDayOfYearTaxoFacets 24.24 (3.5%) 24.41 (4.2%) 0.7% ( -6% - 8%) 0.571 BrowseDateTaxoFacets 22.67 (3.4%) 22.84 (3.9%) 0.7% ( -6% - 8%) 0.528 Fuzzy1 81.52 (1.8%) 82.20 (1.9%) 0.8% ( -2% - 4%) 0.155 HighTermMonthSort 1730.74 (6.0%) 1753.97 (4.6%) 1.3% ( -8% - 12%) 0.424 BrowseDateSSDVFacets 2.96 (3.6%) 3.02 (7.2%) 1.8% ( -8% - 12%) 0.323 TermDTSort 81.57 (5.2%) 83.17 (4.8%) 2.0% ( -7% - 12%) 0.214 BrowseDayOfYearSSDVFacets 10.82 (13.3%) 11.09 (16.3%) 2.5% ( -23% - 37%) 0.590 BrowseRandomLabelTaxoFacets 14.93 (3.9%) 15.37 (5.4%) 2.9% ( -6% - 12%) 0.049 BrowseMonthTaxoFacets 22.11 (7.3%) 22.99 (7.3%) 3.9% ( -9% - 19%) 0.087 ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For additional commands, e-mail: issues-h...@lucene.apache.org