My tests for the latest tags are almost done.
A) 11.0.17
==========
. About 1100 combinations have been run, namely:
- Unix Distributions (SLES 12 and 15, RHEL 7, 8, 9 and 10)
- JVM versions (17, 21, 25, 26 and 27)
- JVM vendors (Adopt, Zulu, Amazon, Oracle and RedHat)
- TLS implementations
- JSSE
- panama for JVM 25+
- tcnative 1.3.5 and 2.0.12
- tcnative 1.3.5 and 2.0.12 with the patch "Align SSL_CONF_CTX clean-up"
- all 4 tcnative variants and panama with OpenSSL 3.0.18, 3.5.4 and 3.6.0
- all tests runs use NIO and NIO2 but not APR (untested here)
The tcantive and panama tests only for tests which specifically include
TLS or crypto.
- no crashes when used with tcnative. Neither with or without the patch
"Align SSL_CONF_CTX clean-up". Hurray!! Normally I see about 10 native
crashes, with the additional patched version of tcnative I would have
expected 20 crashes from the amount of test runs.
- one single crash in org.apache.catalina.startup.TestTomcatStandalone
with JSSE, no tcnative involved. No regression.
- other sporadic failures that are not regressions:
org.apache.catalina.manager.TestManagerWebapp FAILED
for
oracle_jdk17-rhel7.x86_64-jsse
oracle_jdk17-rhel8.x86_64-jsse
org.apache.catalina.tribes.group.interceptors.TestOrderInterceptor
for
zulu_jdk21-rhel9.x86_64-jsse FAILED
org.apache.coyote.http2.TestCancelledUpload FAILED
for
oracle_jdk21-sles15.x86_64-jsse
org.apache.tomcat.websocket.TestWsWebSocketContainerSSL FAILED
for
adopt_jdk25-rhel9.x86_64-tcnative-2.0.12-360-1
- a new test ist failing more often:
org.apache.tomcat.util.net.ocsp.TestOcspSoftFail
for
adopt_jdk17-rhel9.x86_64-tcnative-1.3.5-300-1
adopt_jdk21-rhel10.x86_64-tcnative-1.3.5sp1-360-1
adopt_jdk25-rhel10.x86_64-tcnative-2.0.12-360-1
adopt_jdk25-rhel8.x86_64-panama-3.5.4-1
adopt_jdk25-rhel9.x86_64-tcnative-1.3.5-360-1
amazon_jdk25-rhel10.x86_64-panama-3.6.0-1
amazon_jdk25-rhel10.x86_64-tcnative-1.3.5-360-1
amazon_jdk25-rhel10.x86_64-tcnative-1.3.5sp1-360-1
amazon_jdk25-rhel10.x86_64-tcnative-2.0.12-300-1
amazon_jdk25-rhel10.x86_64-tcnative-2.0.12-360-1
amazon_jdk25-rhel9.x86_64-tcnative-1.3.5-350-1
amazon_jdk25-sles12.x86_64-tcnative-2.0.12sp1-360-1
oracle_jdk21-rhel10.x86_64-tcnative-1.3.5sp1-360-1
oracle_jdk21-rhel10.x86_64-tcnative-2.0.12-360-1
zulu_jdk21-rhel10.x86_64-tcnative-2.0.12-350-1
zulu_jdk25-rhel10.x86_64-panama-3.5.4-1
zulu_jdk25-rhel10.x86_64-panama-3.6.0-1
zulu_jdk25-rhel10.x86_64-tcnative-1.3.5-360-1
zulu_jdk25-rhel10.x86_64-tcnative-2.0.12sp1-350-1
zulu_jdk25-rhel10.x86_64-tcnative-2.0.12sp1-360-1
B) 10.1.51
==========
No results yet, because I can only run 2 TC versions in parallel, which
this time are 11 and 9.
C) 9.0.115
==========
. About 1100 combinations have been run, namely:
- Unix Distributions (SLES 12 and 15, RHEL 7, 8, 9 and 10)
- JVM versions (8, 11, 17, 21 (only a few runs); 25, 26 and 27 have not
yet started)
- JVM vendors (Adopt, Zulu, Amazon, Oracle and RedHat)
- TLS implementations
- JSSE
- panama for JVM 25+
- tcnative 1.3.5 and 2.0.12
- tcnative 1.3.5 and 2.0.12 with the patch "Align SSL_CONF_CTX clean-up"
- all 4 tcnative variants and panama with OpenSSL 3.0.18, 3.5.4 and 3.6.0
- all tests runs use NIO and NIO2 but not APR (untested here)
The tcantive and panama tests only for tests which specifically include
TLS or crypto.
- Only 4 crashes when used with tcnative. Some with, some without the
patch "Align SSL_CONF_CTX clean-up". Normally I see about 25 native
crashes, with the additional patched version of tcnative, but JVM 21-27
still not being run, I would have expected about 30 crashes from the
amount of test runs. So this is still a huge improvement.
org.apache.coyote.http2.TestLargeUpload FAILED (crashed)
for
adopt_jdk21-sles15.x86_64-tcnative-1.3.5-300-1 (patched)
org.apache.tomcat.util.net.TestSSLHostConfigCompat FAILED (crashed)
for
amazon_jdk11-rhel10.x86_64-tcnative-1.3.5-360-1
amazon_jdk17-sles15.x86_64-tcnative-2.0.12-300-1
org.apache.tomcat.util.net.TestSsl FAILED (crashed)
for
oracle_jdk1.8.0-rhel10.x86_64-tcnative-1.3.5-350-1
- two crashes in org.apache.catalina.startup.TestTomcatStandalone with
JSSE, no tcnative involved. No regression.
oracle_jdk1.8.0-rhel7.x86_64-jsse
rh_jdk1.8.0-rhel7.x86_64-jsse
- other sporadic failures that are not regressions:
org.apache.catalina.manager.TestManagerWebapp FAILED
for
rh_jdk1.8.0-rhel8.x86_64-jsse
org.apache.catalina.tribes.group.interceptors.TestNonBlockingCoordinator
FAILED
for
oracle_jdk1.8.0-rhel8.x86_64-jsse
org.apache.tomcat.websocket.TestWsWebSocketContainerSSL FAILED
for
adopt_jdk17-sles12.x86_64-tcnative-2.0.12sp1-360-1
amazon_jdk11-rhel9.x86_64-tcnative-2.0.12-300-1
- sporadic failures in a new test
org.apache.tomcat.util.net.ocsp.TestOcspTimeout FAILED
for
oracle_jdk11-sles15.x86_64-tcnative-1.3.5sp1-360-1
zulu_jdk11-rhel8.x86_64-tcnative-1.3.5sp1-350-1
- two new tests are failing more often:
org.apache.tomcat.util.net.ocsp.TestOcspSoftFail
for
Java 1.8.0, JSSE, all vendors except Oracle, in about 50% of the test
runs. I use a self-compiled OpenSSL 3.6.0-1 via
tomcat.test.openssl.path. Sometimes NIO and NIO2 fail.
org.apache.catalina.startup.TestStartupIPv6Connectors
for
fails always on Java 1.8.0
I can send more details, but wanted to get the results out there before
the next tagging round.
Thanks a bunch for the big improvements!
Best regards,
Rainer
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
