mikemccand commented on pull request #518:
URL: https://github.com/apache/lucene/pull/518#issuecomment-999104766
> It is very important to do the following:
>
> * don't disable tiered compilation and don't enable batch
> * use large index and long lifetime of a single JVM
Thanks @uschindler -- I think I am not disabling tiered compilation.
I run 20 iterations of each task, but it is relatively quick (~13-14 seconds
per JVM instance). I can retry with more per-task iterations to see if the
tiered compilation can improve things later on.
Here's the full JVM command of base and competitor:
```
iter 19
new-mmap:
log: /l/logs.nightly/prefix.new-mmap.19 + stdout
run: /opt/jdk-18-ea-28/bin/java --add-modules jdk.incubator.foreign
-Xmx32g -Xms32g -server -XX:+UseParallelGC -Djava.io.tmpdir=/l/tmp
-XX:StartFlightRecording=dumponexit=true,maxsize=250M,settings=/l/util/src/\
python/profiling.jfc,filename=/l/util/bench-search-prefix-new-mmap-19.jfr
-XX:+UnlockDiagnosticVMOptions -XX:+DebugNonSafepoints -classpath
/l/trunk-new-mmap/lucene/core/build/libs/lucene-core-10.0.0-SNAPSHOT.jar:/l/\
trunk-new-mmap/lucene/core/build/classes/java/test:/l/trunk-new-mmap/lucene/sandbox/build/classes/java/main:/l/trunk-new-mmap/lucene/misc/build/classes/java/main:/l/trunk-new-mmap/lucene/facet/build/classes/java/main\
:/l/trunk-new-mmap/lucene/analysis/common/build/classes/java/main:/l/trunk-new-mmap/lucene/analysis/icu/build/classes/java/main:/l/trunk-new-mmap/lucene/queryparser/build/classes/java/main:/l/trunk-new-mmap/lucene/gr\
ouping/build/classes/java/main:/l/trunk-new-mmap/lucene/suggest/build/classes/java/main:/l/trunk-new-mmap/lucene/highlighter/build/classes/java/main:/l/trunk-new-mmap/lucene/codecs/build/classes/java/main:/l/trunk-ne\
w-mmap/lucene/queries/build/classes/java/main:/home/mike/.gradle/caches/modules-2/files-2.1/com.carrotsearch/hppc/0.9.0/fcc952fb6d378266b943bef9f15e67a4d45cfa88/hppc-0.9.0.jar:/l/util/lib/HdrHistogram.jar:/l/util/bui\
ld perf.SearchPerfTest -dirImpl MMapDirectory -indexPath
/l/indices/wikimediumall.trunk.facets.taxonomy:Date.taxonomy:Month.taxonomy:DayOfYear.taxonomy:RandomLabel.taxonomy.sortedset:Month.sortedset:DayOfYear.sorteds\
et:RandomLabel.sortedset.Lucene90.Lucene90.dvfields.nd27.625M -facets
taxonomy:Date;Date -facets taxonomy:Month;Month -facets
taxonomy:DayOfYear;DayOfYear -facets taxonomy:RandomLabel.taxonomy;RandomLabel
-facets sor\
tedset:Month;Month -facets sortedset:DayOfYear;DayOfYear -facets
sortedset:RandomLabel.sortedset;RandomLabel -analyzer
StandardAnalyzerNoStopWords -taskSource
/l/util/tasks/wikimedium.10M.nostopwords.tasks -searchThr\
eadCount 6 -taskRepeatCount 20 -field body -tasksPerCat 1 -staticSeed
-291966 -seed -5054409 -similarity BM25Similarity -commit multi -hiliteImpl
FastVectorHighlighter -log /l/logs.nightly/prefix.new-mmap.19 -topN 10\
-pk
13.1 s
base:
log: /l/logs.nightly/prefix.base.19 + stdout
run: /opt/jdk-18-ea-28/bin/java --add-modules jdk.incubator.foreign
-Xmx32g -Xms32g -server -XX:+UseParallelGC -Djava.io.tmpdir=/l/tmp
-XX:StartFlightRecording=dumponexit=true,maxsize=250M,settings=/l/util/src/\
python/profiling.jfc,filename=/l/util/bench-search-prefix-base-19.jfr
-XX:+UnlockDiagnosticVMOptions -XX:+DebugNonSafepoints -classpath
/l/trunk/lucene/core/build/libs/lucene-core-10.0.0-SNAPSHOT.jar:/l/trunk/lucene/\
core/build/classes/java/test:/l/trunk/lucene/sandbox/build/classes/java/main:/l/trunk/lucene/misc/build/classes/java/main:/l/trunk/lucene/facet/build/classes/java/main:/l/trunk/lucene/analysis/common/build/classes/ja\
va/main:/l/trunk/lucene/analysis/icu/build/classes/java/main:/l/trunk/lucene/queryparser/build/classes/java/main:/l/trunk/lucene/grouping/build/classes/java/main:/l/trunk/lucene/suggest/build/classes/java/main:/l/tru\
nk/lucene/highlighter/build/classes/java/main:/l/trunk/lucene/codecs/build/classes/java/main:/l/trunk/lucene/queries/build/classes/java/main:/home/mike/.gradle/caches/modules-2/files-2.1/com.carrotsearch/hppc/0.9.0/f\
cc952fb6d378266b943bef9f15e67a4d45cfa88/hppc-0.9.0.jar:/l/util/lib/HdrHistogram.jar:/l/util/build
perf.SearchPerfTest -dirImpl MMapDirectory -indexPath
/l/indices/wikimediumall.trunk.facets.taxonomy:Date.taxonomy:Mon\
th.taxonomy:DayOfYear.taxonomy:RandomLabel.taxonomy.sortedset:Month.sortedset:DayOfYear.sortedset:RandomLabel.sortedset.Lucene90.Lucene90.dvfields.nd27.625M
-facets taxonomy:Date;Date -facets taxonomy:Month;Month -fa\
cets taxonomy:DayOfYear;DayOfYear -facets
taxonomy:RandomLabel.taxonomy;RandomLabel -facets sortedset:Month;Month -facets
sortedset:DayOfYear;DayOfYear -facets
sortedset:RandomLabel.sortedset;RandomLabel -analyzer St\
andardAnalyzerNoStopWords -taskSource
/l/util/tasks/wikimedium.10M.nostopwords.tasks -searchThreadCount 6
-taskRepeatCount 20 -field body -tasksPerCat 1 -staticSeed -291966 -seed
-5054409 -similarity BM25Similarity -\
commit multi -hiliteImpl FastVectorHighlighter -log
/l/logs.nightly/prefix.base.19 -topN 10 -pk
13.7 s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
