[ https://issues.apache.org/jira/browse/GEODE-10305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542670#comment-17542670 ]
Jianxia Chen commented on GEODE-10305: -------------------------------------- The standard output shows that there is some issue when starting the locator: {code:java} [info 2022/05/05 21:36:06.098 UTC <Test worker> tid=0x19] Executing command: start locator --name=loc --classpath=/tmp/geode_container_install8549633813411705254/cargo_containers/Tomcat8AndCurrentModules/tomcat-8.5.66/apache-tomcat-8.5.66/lib/*:/tmp/geode_container_install8549633813411705254/cargo_containers/Tomcat8AndCurrentModules/tomcat-8.5.66/apache-tomcat-8.5.66/bin/* --port=25498 --dir=/tmp/junit439159077415808630/locator Command result for <start locator --name=loc --classpath=/tmp/geode_container_install8549633813411705254/cargo_containers/Tomcat8AndCurrentModules/tomcat-8.5.66/apache-tomcat-8.5.66/lib/*:/tmp/geode_container_install8549633813411705254/cargo_containers/Tomcat8AndCurrentModules/tomcat-8.5.66/apache-tomcat-8.5.66/bin/* --port=25498 --dir=/tmp/junit439159077415808630/locator>: ?[34m _________________________ __ / _____/ ______/ ______/ /____/ / / / __/ /___ /_____ / _____ / / /__/ / ____/ _____/ / / / / /______/_/ /______/_/ /_/ 1.15.0-build.0 ?[0m ?[36mMonitor and Manage Apache Geode?[0m .............. Locator in /tmp/junit439159077415808630/locator on heavy-lifter-e2fd6dd2-c530-54ef-ab7c-b95e0e8cca34.c.apachegeode-ci.internal[25498] as loc is currently online. Process ID: 228190 Uptime: 18 seconds Geode Version: 1.15.0-build.0 Java Version: 1.8.0_332 Log File: /tmp/junit439159077415808630/locator/loc.log JVM Arguments: -Dgemfire.enable-cluster-configuration=true -Dgemfire.load-cluster-configuration-from-dir=false -Dgemfire.launcher.registerSignalHandlers=true -Djava.awt.headless=true -Dsun.rmi.dgc.server.gcInterval=9223372036854775806 Class-Path: <omitted here due to long classpath> Unable to auto-connect (Security Manager may be enabled). Please use "connect --locator=heavy-lifter-e2fd6dd2-c530-54ef-ab7c-b95e0e8cca34.c.apachegeode-ci.internal[25498]" to connect Gfsh to the locator. Failed to connect; unknown cause: Exception caused JMX Manager startup to fail because: 'HTTP service failed to start' {code} Then immediately after that, starting server hitting ForcedDisconnectException: {code:java} [info 2022/05/05 21:36:24.636 UTC <Test worker> tid=0x19] Executing command: start server --name=server --server-port=0 --classpath=/tmp/geode_container_install8549633813411705254/cargo_containers/Tomcat8AndCurrentModules/tomcat-8.5.66/apache-tomcat-8.5.66/lib/*:/tmp/geode_container_install8549633813411705254/cargo_containers/Tomcat8AndCurrentModules/tomcat-8.5.66/apache-tomcat-8.5.66/bin/* --locators=localhost[25498] --dir=/tmp/junit439159077415808630/server Command result for <start server --name=server --server-port=0 --classpath=/tmp/geode_container_install8549633813411705254/cargo_containers/Tomcat8AndCurrentModules/tomcat-8.5.66/apache-tomcat-8.5.66/lib/*:/tmp/geode_container_install8549633813411705254/cargo_containers/Tomcat8AndCurrentModules/tomcat-8.5.66/apache-tomcat-8.5.66/bin/* --locators=localhost[25498] --dir=/tmp/junit439159077415808630/server>: .......The Cache Server process terminated unexpectedly with exit status 1. Please refer to the log file in /tmp/junit439159077415808630/server for full details. SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/tmp/geode_container_install8549633813411705254/cargo_containers/Tomcat8AndCurrentModules/tomcat-8.5.66/apache-tomcat-8.5.66/lib/slf4j-jdk14-1.7.32.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/geode/geode/geode-assembly/build/install/apache-geode/lib/log4j-slf4j-impl-2.17.2.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory] Exception in thread "main" org.apache.geode.distributed.DistributedSystemDisconnectedException: Distribution manager on heavy-lifter-e2fd6dd2-c530-54ef-ab7c-b95e0e8cca34(server:240126)<v1>:41036 started at Thu May 05 21:36:30 UTC 2022: Member isn't responding to heartbeat requests, caused by org.apache.geode.ForcedDisconnectException: Member isn't responding to heartbeat requests at org.apache.geode.distributed.internal.ClusterDistributionManager$Stopper.generateCancelledException(ClusterDistributionManager.java:2899) at org.apache.geode.distributed.internal.InternalDistributedSystem$Stopper.generateCancelledException(InternalDistributedSystem.java:1183) at org.apache.geode.internal.cache.GemFireCacheImpl$Stopper.generateCancelledException(GemFireCacheImpl.java:5201) at org.apache.geode.CancelCriterion.checkCancelInProgress(CancelCriterion.java:83) at org.apache.geode.cache.query.cq.internal.CqServiceImpl.<init>(CqServiceImpl.java:166) at org.apache.geode.cache.query.cq.internal.CqServiceFactoryImpl.create(CqServiceFactoryImpl.java:59) at org.apache.geode.cache.query.internal.cq.CqServiceProvider.create(CqServiceProvider.java:63) at org.apache.geode.internal.cache.GemFireCacheImpl.<init>(GemFireCacheImpl.java:1004) at org.apache.geode.internal.cache.GemFireCacheImpl.<init>(GemFireCacheImpl.java:864) at org.apache.geode.internal.cache.InternalCacheBuilder.create(InternalCacheBuilder.java:187) at org.apache.geode.internal.cache.InternalCacheBuilder.create(InternalCacheBuilder.java:158) at org.apache.geode.cache.CacheFactory.create(CacheFactory.java:142) at org.apache.geode.distributed.internal.DefaultServerLauncherCacheProvider.createCache(DefaultServerLauncherCacheProvider.java:52) at org.apache.geode.distributed.ServerLauncher.createCache(ServerLauncher.java:913) at org.apache.geode.distributed.ServerLauncher.start(ServerLauncher.java:814) at org.apache.geode.distributed.ServerLauncher.run(ServerLauncher.java:740) at org.apache.geode.distributed.ServerLauncher.main(ServerLauncher.java:259) Caused by: org.apache.geode.ForcedDisconnectException: Member isn't responding to heartbeat requests at org.apache.geode.distributed.internal.DistributionImpl$LifecycleListenerImpl.forcedDisconnect(DistributionImpl.java:941) at org.apache.geode.distributed.internal.membership.gms.GMSMembership$ManagerImpl.lambda$uncleanShutdownDS$0(GMSMembership.java:1792) at java.lang.Thread.run(Thread.java:750) {code} > CI Failure: > TomcatSessionBackwardsCompatibilityTomcat8WithOldModulesMixedWithCurrentCanDoPutFromOldModuleTest > failed > --------------------------------------------------------------------------------------------------------------------- > > Key: GEODE-10305 > URL: https://issues.apache.org/jira/browse/GEODE-10305 > Project: Geode > Issue Type: Bug > Components: tests > Affects Versions: 1.16.0 > Reporter: Eric Shu > Assignee: Jianxia Chen > Priority: Major > Labels: needsTriage > > {noformat} > org.gradle.internal.exceptions.DefaultMultiCauseException: Multiple Failures > (2 failures) > org.opentest4j.AssertionFailedError: [The Cache Server process > terminated unexpectedly with exit status 1. Please refer to the log file in > /tmp/junit439159077415808630/server for full details. > SLF4J: Class path contains multiple SLF4J bindings. > SLF4J: Found binding in > [jar:file:/tmp/geode_container_install8549633813411705254/cargo_containers/Tomcat8AndCurrentModules/tomcat-8.5.66/apache-tomcat-8.5.66/lib/slf4j-jdk14-1.7.32.jar!/org/slf4j/impl/StaticLoggerBinder.class] > SLF4J: Found binding in > [jar:file:/home/geode/geode/geode-assembly/build/install/apache-geode/lib/log4j-slf4j-impl-2.17.2.jar!/org/slf4j/impl/StaticLoggerBinder.class] > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an > explanation. > SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory] > {noformat} > This is caused by ForcedDisconnectException during cache creation. > {noformat} > Exception in thread "main" > org.apache.geode.distributed.DistributedSystemDisconnectedException: > Distribution manager on > heavy-lifter-e2fd6dd2-c530-54ef-ab7c-b95e0e8cca34(server:240126)<v1>:41036 > started at Thu May 05 21:36:30 UTC 2022: Member isn't responding to heartbeat > requests, caused by org.apache.geode.ForcedDisconnectException: Member isn't > responding to heartbeat requests > at > org.apache.geode.distributed.internal.ClusterDistributionManager$Stopper.generateCancelledException(ClusterDistributionManager.java:2899) > at > org.apache.geode.distributed.internal.InternalDistributedSystem$Stopper.generateCancelledException(InternalDistributedSystem.java:1183) > at > org.apache.geode.internal.cache.GemFireCacheImpl$Stopper.generateCancelledException(GemFireCacheImpl.java:5201) > at > org.apache.geode.CancelCriterion.checkCancelInProgress(CancelCriterion.java:83) > at > org.apache.geode.cache.query.cq.internal.CqServiceImpl.<init>(CqServiceImpl.java:166) > at > org.apache.geode.cache.query.cq.internal.CqServiceFactoryImpl.create(CqServiceFactoryImpl.java:59) > at > org.apache.geode.cache.query.internal.cq.CqServiceProvider.create(CqServiceProvider.java:63) > at > org.apache.geode.internal.cache.GemFireCacheImpl.<init>(GemFireCacheImpl.java:1004) > at > org.apache.geode.internal.cache.GemFireCacheImpl.<init>(GemFireCacheImpl.java:864) > at > org.apache.geode.internal.cache.InternalCacheBuilder.create(InternalCacheBuilder.java:187) > at > org.apache.geode.internal.cache.InternalCacheBuilder.create(InternalCacheBuilder.java:158) > at org.apache.geode.cache.CacheFactory.create(CacheFactory.java:142) > at > org.apache.geode.distributed.internal.DefaultServerLauncherCacheProvider.createCache(DefaultServerLauncherCacheProvider.java:52) > at > org.apache.geode.distributed.ServerLauncher.createCache(ServerLauncher.java:913) > at > org.apache.geode.distributed.ServerLauncher.start(ServerLauncher.java:814) > at > org.apache.geode.distributed.ServerLauncher.run(ServerLauncher.java:740) > at > org.apache.geode.distributed.ServerLauncher.main(ServerLauncher.java:259) > Caused by: org.apache.geode.ForcedDisconnectException: Member isn't > responding to heartbeat requests > at > org.apache.geode.distributed.internal.DistributionImpl$LifecycleListenerImpl.forcedDisconnect(DistributionImpl.java:941) > at > org.apache.geode.distributed.internal.membership.gms.GMSMembership$ManagerImpl.lambda$uncleanShutdownDS$0(GMSMembership.java:1792) > at java.lang.Thread.run(Thread.java:750) > {noformat} > Artifacts can be found here: > https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/upgrade-test-openjdk8/builds/331 -- This message was sent by Atlassian Jira (v8.20.7#820007)