I hit a dunit hang in one of my precheckin runs. The only test mentioned in callstacks/dunit-hangs.txt is ClusterConfigLocatorRestartDUnitTest.
I see some Pooled Message Processor threads that might be hung waiting for the same java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject on OverflowQueueWithDMStat. ClusterConfigurationLoader and FunctionStreamingResultCollector might be involved. Here's the link if someone working on cluster config wants to download the tgz and look through the callstacks: https://concourse.apachegeode-ci.info/builds/31696 "RMI TCP Connection(1)-172.17.0.14" #34 daemon prio=5 os_prio=0 cpu=1485.20ms elapsed=4864.19s tid=0x00007f6950001800 nid=0x213 waiting on condition [0x00007f696b5f3000] java.lang.Thread.State: TIMED_WAITING (parking) at jdk.internal.misc.Unsafe.park([email protected]/Native Method) - parking to wait for <0x00000000ed7bf538> (a java.util.concurrent.CountDownLatch$Sync) at java.util.concurrent.locks.LockSupport.parkNanos([email protected] /LockSupport.java:234) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos([email protected] /AbstractQueuedSynchronizer.java:1079) at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos([email protected] /AbstractQueuedSynchronizer.java:1369) at java.util.concurrent.CountDownLatch.await([email protected] /CountDownLatch.java:278) at org.apache.geode.internal.util.concurrent.StoppableCountDownLatch.await(StoppableCountDownLatch.java:61) at org.apache.geode.distributed.internal.ReplyProcessor21.basicWait(ReplyProcessor21.java:714) at org.apache.geode.distributed.internal.ReplyProcessor21.waitForRepliesUninterruptibly(ReplyProcessor21.java:785) at org.apache.geode.distributed.internal.ReplyProcessor21.waitForRepliesUninterruptibly(ReplyProcessor21.java:762) at org.apache.geode.internal.cache.execute.FunctionStreamingResultCollector.getResult(FunctionStreamingResultCollector.java:142) at org.apache.geode.internal.cache.ClusterConfigurationLoader.requestConfigurationFromOneLocator(ClusterConfigurationLoader.java:313) at org.apache.geode.internal.cache.ClusterConfigurationLoader.requestConfigurationFromLocators(ClusterConfigurationLoader.java:282) at org.apache.geode.internal.cache.GemFireCacheImpl.requestSharedConfiguration(GemFireCacheImpl.java:1074) at org.apache.geode.internal.cache.GemFireCacheImpl.<init>(GemFireCacheImpl.java:859) - locked <0x00000000ed7bf7f8> (a java.lang.Class for org.apache.geode.internal.cache.GemFireCacheImpl) at org.apache.geode.internal.cache.GemFireCacheImpl.basicCreate(GemFireCacheImpl.java:796) - locked <0x00000000ed7bf7f8> (a java.lang.Class for org.apache.geode.internal.cache.GemFireCacheImpl) at org.apache.geode.internal.cache.GemFireCacheImpl.create(GemFireCacheImpl.java:785) at org.apache.geode.cache.CacheFactory.create(CacheFactory.java:176) - locked <0x00000000ed6005b0> (a java.lang.Class for org.apache.geode.cache.CacheFactory) at org.apache.geode.cache.CacheFactory.create(CacheFactory.java:223) - locked <0x00000000ed6005b0> (a java.lang.Class for org.apache.geode.cache.CacheFactory) at org.apache.geode.test.junit.rules.ServerStarterRule.startServer(ServerStarterRule.java:174) at org.apache.geode.test.junit.rules.ServerStarterRule.before(ServerStarterRule.java:80) at org.apache.geode.test.dunit.rules.ClusterStartupRule.lambda$startServerVM$729766c4$1(ClusterStartupRule.java:248) at org.apache.geode.test.dunit.rules.ClusterStartupRule$$Lambda$131/0x00000008401c0840.call(Unknown Source) at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0([email protected]/Native Method) at jdk.internal.reflect.NativeMethodAccessorImpl.invoke([email protected] /NativeMethodAccessorImpl.java:62) at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke([email protected] /DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke([email protected]/Method.java:566) at org.apache.geode.test.dunit.internal.MethodInvoker.executeObject(MethodInvoker.java:123) at org.apache.geode.test.dunit.internal.RemoteDUnitVM.executeMethodOnObject(RemoteDUnitVM.java:69) at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0([email protected]/Native Method) at jdk.internal.reflect.NativeMethodAccessorImpl.invoke([email protected] /NativeMethodAccessorImpl.java:62) at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke([email protected] /DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke([email protected]/Method.java:566) at sun.rmi.server.UnicastServerRef.dispatch([email protected] /UnicastServerRef.java:359) at sun.rmi.transport.Transport$1.run([email protected] /Transport.java:200) at sun.rmi.transport.Transport$1.run([email protected] /Transport.java:197) at java.security.AccessController.doPrivileged([email protected]/Native Method) at sun.rmi.transport.Transport.serviceCall([email protected] /Transport.java:196) at sun.rmi.transport.tcp.TCPTransport.handleMessages([email protected] /TCPTransport.java:562) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0([email protected] /TCPTransport.java:796) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.lambda$run$0([email protected] /TCPTransport.java:677) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler$$Lambda$126/0x000000084019f440.run([email protected]/Unknown Source) at java.security.AccessController.doPrivileged([email protected]/Native Method) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run([email protected] /TCPTransport.java:676) at java.util.concurrent.ThreadPoolExecutor.runWorker([email protected] /ThreadPoolExecutor.java:1128) at java.util.concurrent.ThreadPoolExecutor$Worker.run([email protected] /ThreadPoolExecutor.java:628) at java.lang.Thread.run([email protected]/Thread.java:834) Locked ownable synchronizers: - <0x00000000ed5c8f60> (a java.util.concurrent.ThreadPoolExecutor$Worker)
