[
https://issues.apache.org/jira/browse/LUCENE-9793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17287776#comment-17287776
]
Dawid Weiss commented on LUCENE-9793:
-------------------------------------
Full check (without tests):
{code:java}
./gradlew check -x test -Ptask.times=true {code}
{code:java}
Aggregate task times (possibly running in parallel!):
361.34 sec. renderSiteJavadoc
327.97 sec. renderJavadoc
195.76 sec. compileTestJava
177.50 sec. compileJava
165.35 sec. ecjLintMain
153.95 sec. ecjLintTest
106.03 sec. checkBrokenLinks
48.99 sec. buildLocalJavadocLinksSite
46.98 sec. spotlessJava
29.97 sec. validateSourcePatterns
29.21 sec. jrubyPrepare
25.82 sec. buildSite
9.65 sec. prepareLocalJavadocLinksSiteSources
8.49 sec. rat
8.39 sec. changesToHtml
6.35 sec. checkUnusedConstraints
5.95 sec. jar
5.64 sec. verifyLocks
4.66 sec. prepareSiteSources
3.35 sec. ecjLintTools
2.96 sec. validateLogCalls
2.31 sec. compileToolsJava
1.34 sec. checkSite
1.27 sec. validateJarChecksums
1.18 sec. checkLocalJavadocLinksSite
0.86 sec. validateJarLicenses
0.71 sec. processRefGuideResources
0.51 sec. gitStatus
0.44 sec. collectJarInfos
0.35 sec. copyTestResources
0.33 sec. processResources
0.28 sec. copyDocumentationAssets
0.23 sec. processTestResources
0.18 sec. markdownToHtml
0.07 sec. createDocumentationIndex
0.02 sec. spotlessJavaCheck
0.02 sec. createMiniDocumentationIndex
0.02 sec. spotlessInternalRegisterDependencies
0.01 sec. copyChangesToHtmlForMiniSite
0.01 sec. checkDanglingLicenseFiles
0.01 sec. syncConf
0.01 sec. allHelpFilesExit
0.00 sec. validateConfigFileSanity
0.00 sec. checkWorkingCopyClean
0.00 sec. gradlewScriptsTweaked
0.00 sec. copyMiniDocumentationAssets
0.00 sec. versionsPropsAreSorted
{code}
> Measure check/precommit aggregate task wall time
> ------------------------------------------------
>
> Key: LUCENE-9793
> URL: https://issues.apache.org/jira/browse/LUCENE-9793
> Project: Lucene - Core
> Issue Type: Task
> Reporter: Dawid Weiss
> Assignee: Dawid Weiss
> Priority: Minor
>
> We should keep check/ precommit reasonably fast. I wondered what currently
> takes so long and wrote a small script that aggregates wall times of all
> executed tasks (not just on check).
> You can enabled it with {{-Ptask.times=true}}.
> My results of running precommit on a Linux box:
> {code:java}
> Aggregate task times (possibly running in parallel!):
> 307.06 sec. renderJavadoc
> 251.34 sec. compileJava
> 203.38 sec. compileTestJava
> 155.93 sec. ecjLintMain
> 146.02 sec. ecjLintTest
> 56.44 sec. spotlessJava
> 30.06 sec. validateSourcePatterns
> 18.64 sec. forbiddenApisMain
> 12.89 sec. collectJarInfos
> 11.65 sec. forbiddenApisTest
> 10.53 sec. rat
> 5.95 sec. jar
> 4.14 sec. spotlessInternalRegisterDependencies
> 3.08 sec. ecjLintTools
> 2.71 sec. compileToolsJava
> 2.68 sec. validateLogCalls
> 1.76 sec. validateJarChecksums
> 1.66 sec. processRefGuideResources
> 1.45 sec. validateJarLicenses
> 0.95 sec. gitStatus
> 0.80 sec. processResources
> 0.74 sec. copyTestResources
> 0.54 sec. processTestResources
> 0.52 sec. verifyLocks
> 0.10 sec. forbiddenApisTools
> 0.03 sec. syncConf
> 0.03 sec. checkDanglingLicenseFiles
> 0.02 sec. versionsPropsAreSorted
> 0.02 sec. spotlessJavaCheck
> 0.01 sec. validateConfigFileSanity
> 0.01 sec. checkWorkingCopyClean {code}
> So it's mostly javac and javadoc taking all that time... We could move ecj
> linter to CI-only runs if people start complaining too much. :)
> [~mikemccand]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]