[ 
https://issues.apache.org/jira/browse/LUCENE-9670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17267953#comment-17267953
 ] 

Michael McCandless commented on LUCENE-9670:
--------------------------------------------

Thanks [~dweiss] – maybe it is a JDK 15 issue?  Or Arch Linux maybe?

Oh, or, maybe something in my gradle config.  I have this in my 
{{~/.gradle/gradle.properties}}:
{noformat}
# These settings have been generated automatically on the first run.
# See gradlew :helpLocalSettings for more information.
systemProp.file.encoding=UTF-8
org.gradle.jvmargs=-Xmx3g
org.gradle.parallel=true
org.gradle.priority=normal
org.gradle.warning.mode=none


# You may disable the background daemon if it consumes too much memory.
#org.gradle.daemon=true
#org.gradle.daemon.idletimeout=900000
org.gradle.daemon=false


# Maximum number of parallel gradle workers.
org.gradle.workers.max=64


# Maximum number of test JVMs forked per test task.
tests.jvms=64


#org.gradle.console=verbose
org.gradle.jvmargs=-Xms1g -Xmx1g -XX:+AlwaysPreTouch 
-XX:+UseTransparentHugePages -XX:+UseParallelGC -XX:TieredStopAtLevel=1 
-XX:ActiveProcessorCount=1
#tests.heapsize=128m
#tests.minheapsize=128m
tests.heapsize=512m
tests.minheapsize=512m
#tests.jvmargs=-XX:+AlwaysPreTouch -XX:+UseTransparentHugePages
#-XX:+UseParallelGC -XX:TieredStopAtLevel=1 -XX:ActiveProcessorCount=1


tests.jvmargs=-XX:+AlwaysPreTouch -XX:+UseTransparentHugePages 
-XX:+UseParallelGC -XX:TieredStopAtLevel=1 -XX:ActiveProcessorCount=1 
-XX:+UnlockDiagnosticVMOptions -XX:+PreserveFramePointer
# -XX:+DumpPerfMapAtExit
tests.workDir=/tmp/lucene_gradle{noformat}
That {{/tmp/lucene_gradle}} is a {{tmpfs}} mount.

In the mean-time, I'll add a silly retry wrapper around the {{gradle 
precommit}} in nightly benchmarks.

> gradle precommit sometimes fails with "IOException: stream closed" from 
> javadoc in nightly benchmarks
> -----------------------------------------------------------------------------------------------------
>
>                 Key: LUCENE-9670
>                 URL: https://issues.apache.org/jira/browse/LUCENE-9670
>             Project: Lucene - Core
>          Issue Type: Bug
>            Reporter: Michael McCandless
>            Priority: Major
>
> I recently added tracking how long {{gradle precommit}} takes each night so 
> we can track slowdowns over time.
> But it sometimes fails with:
> {noformat}
> > Task :lucene:join:renderJavadoc FAILED
> Could not read standard output of command '/opt/jdk-15.0.1/bin/javadoc'.
> java.io.IOException: Stream Closed
>         at java.base/java.io.FileOutputStream.writeBytes(Native Method)
>         at java.base/java.io.FileOutputStream.write(FileOutputStream.java:347)
>         at 
> java.base/java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:81)
>         at 
> java.base/java.io.BufferedOutputStream.flush(BufferedOutputStream.java:142)
>         at 
> org.gradle.process.internal.streams.ExecOutputHandleRunner.forwardContent(ExecOutputHandleRunner.java:68)
>         at 
> org.gradle.process.internal.streams.ExecOutputHandleRunner.run(ExecOutputHandleRunner.java:53)
>         at 
> org.gradle.internal.operations.CurrentBuildOperationPreservingRunnable.run(CurrentBuildOperationPreservingRunnable.java:42)
>         at 
> org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:64)
>         at 
> org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:48)
>         at 
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
>         at 
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
>         at 
> org.gradle.internal.concurrent.ThreadFactoryImpl$ManagedThreadRunnable.run(ThreadFactoryImpl.java:56)
>         at java.base/java.lang.Thread.run(Thread.java:832) {noformat}
> I'm not sure why ... when I run {{./gradlew precommit}} interactively it 
> doesn't seem to do this.
> The nightly tool is quite simple – it just launches a sub-process using 
> {{os.system}}: (first to {{git clean}} then to run {{./gradlew precommit)}}: 
> https://github.com/mikemccand/luceneutil/blob/master/src/python/runNightlyGradleTestPrecommit.py



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org

Reply via email to