jpountz commented on PR #13244:
URL: https://github.com/apache/lucene/pull/13244#issuecomment-2037277263
I hacked luceneutil to clear my page cache with `echo 1 >
/proc/sys/vm/drop_caches` before each query:
```patch
diff --git a/src/main/perf/TaskThreads.java b/src/main/perf/TaskThreads.java
index 313664f..b42a1bd 100644
--- a/src/main/perf/TaskThreads.java
+++ b/src/main/perf/TaskThreads.java
@@ -89,6 +89,12 @@ public class TaskThreads {
// Done
break;
}
+ ProcessBuilder pb = new
ProcessBuilder("/bin/bash", "/home/jpountz/drop_caches.sh");
+ Process p = pb.start();
+ int code = p.waitFor();
+ if (code != 0) {
+ throw new Error();
+ }
final long t0 = System.nanoTime();
try {
task.go(indexState,
taskParser);
```
This gives the following output on wikibigall. Differences are somewhat
bigger and some p values are low-ish, e.g. `OrHighNotLow` and `IntNRQ` (faster)
or `HighTermDayOfYearSort` and `HighTermTitleBDVSort` (slower) but nothing
jumps out as being a blocker for this change.
```
TaskQPS baseline StdDevQPS
my_modified_version StdDev Pct diff p-value
HighTermDayOfYearSort 356.29 (7.2%) 346.35
(5.8%) -2.8% ( -14% - 11%) 0.178
HighTermTitleBDVSort 16.47 (7.1%) 16.02
(4.3%) -2.7% ( -13% - 9%) 0.139
HighTerm 284.20 (8.8%) 276.94
(10.1%) -2.6% ( -19% - 17%) 0.395
Respell 51.19 (3.7%) 50.49
(4.4%) -1.4% ( -9% - 6%) 0.286
LowSpanNear 19.00 (3.3%) 18.76
(3.4%) -1.3% ( -7% - 5%) 0.222
PKLookup 238.02 (4.4%) 235.09
(6.7%) -1.2% ( -11% - 10%) 0.494
Wildcard 183.79 (5.4%) 181.86
(6.3%) -1.1% ( -12% - 11%) 0.571
LowPhrase 67.32 (5.7%) 66.67
(5.6%) -1.0% ( -11% - 11%) 0.591
HighSpanNear 26.83 (4.8%) 26.58
(3.6%) -0.9% ( -8% - 7%) 0.501
HighIntervalsOrdered 3.10 (3.6%) 3.07
(3.9%) -0.9% ( -8% - 6%) 0.451
HighPhrase 122.98 (5.7%) 121.92
(4.0%) -0.9% ( -9% - 9%) 0.578
Fuzzy2 61.85 (3.3%) 61.56
(4.1%) -0.5% ( -7% - 7%) 0.693
HighSloppyPhrase 12.79 (2.9%) 12.73
(3.2%) -0.4% ( -6% - 5%) 0.642
Fuzzy1 78.45 (3.4%) 78.18
(3.0%) -0.3% ( -6% - 6%) 0.728
MedSpanNear 5.64 (2.8%) 5.63
(2.6%) -0.3% ( -5% - 5%) 0.735
LowSloppyPhrase 2.31 (3.6%) 2.31
(3.7%) -0.2% ( -7% - 7%) 0.843
MedSloppyPhrase 13.62 (3.5%) 13.59
(4.0%) -0.2% ( -7% - 7%) 0.862
MedIntervalsOrdered 11.97 (4.2%) 11.94
(5.0%) -0.2% ( -9% - 9%) 0.891
AndHighHigh 45.42 (5.0%) 45.33
(4.2%) -0.2% ( -8% - 9%) 0.893
OrHighMed 214.12 (8.0%) 214.07
(5.9%) -0.0% ( -12% - 15%) 0.992
HighTermMonthSort 1762.09 (6.4%) 1764.93
(5.3%) 0.2% ( -10% - 12%) 0.931
OrHighNotMed 331.20 (7.1%) 331.97
(8.7%) 0.2% ( -14% - 17%) 0.926
OrNotHighMed 276.66 (7.0%) 277.84
(10.0%) 0.4% ( -15% - 18%) 0.876
LowIntervalsOrdered 18.28 (4.3%) 18.41
(3.7%) 0.7% ( -6% - 9%) 0.593
Prefix3 429.15 (3.0%) 433.02
(3.2%) 0.9% ( -5% - 7%) 0.353
HighTermTitleSort 124.84 (4.8%) 126.06
(5.9%) 1.0% ( -9% - 12%) 0.565
MedTerm 405.21 (10.5%) 409.60
(8.7%) 1.1% ( -16% - 22%) 0.722
AndHighMed 216.72 (6.6%) 219.11
(4.7%) 1.1% ( -9% - 13%) 0.541
MedPhrase 79.97 (5.5%) 80.87
(6.0%) 1.1% ( -9% - 13%) 0.540
TermDTSort 165.81 (7.8%) 167.85
(9.0%) 1.2% ( -14% - 19%) 0.644
OrNotHighLow 588.69 (3.4%) 596.51
(5.2%) 1.3% ( -7% - 10%) 0.338
OrHighLow 436.10 (5.7%) 442.05
(6.9%) 1.4% ( -10% - 14%) 0.497
LowTerm 725.03 (5.4%) 735.84
(6.4%) 1.5% ( -9% - 14%) 0.426
OrHighNotHigh 171.64 (8.7%) 174.23
(8.7%) 1.5% ( -14% - 20%) 0.583
OrHighHigh 72.38 (5.3%) 73.65
(4.8%) 1.8% ( -7% - 12%) 0.269
AndHighLow 560.60 (5.0%) 572.60
(5.6%) 2.1% ( -8% - 13%) 0.200
OrNotHighHigh 157.28 (6.5%) 160.77
(9.3%) 2.2% ( -12% - 19%) 0.382
IntNRQ 964.08 (8.8%) 1010.37
(5.3%) 4.8% ( -8% - 20%) 0.036
OrHighNotLow 276.39 (10.3%) 290.60
(8.3%) 5.1% ( -12% - 26%) 0.082
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org
