[ https://issues.apache.org/jira/browse/GEODE-6284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16745407#comment-16745407 ]
Dan Smith commented on GEODE-6284: ---------------------------------- The RMI exception means it couldn't talk to one of the dunit processes. In the logs, we see this error, which I think indicates the process crashed! {noformat} [vm1] # [vm1] # A fatal error has been detected by the Java Runtime Environment: [vm1] # [vm1] # SIGSEGV (0xb) at pc=0x00007f99fca8f63f, pid=5176, tid=5421[thread 5418 also had an error] [vm1] [thread 5427 also had an error]# [vm1] [thread 5426 also had an error][thread 5423 also had an error] [vm1] # JRE version: OpenJDK Runtime Environment (11.0.1+13) (build 11.0.1+13-Debian-3) [vm1] # Java VM: OpenJDK 64-Bit Server VM (11.0.1+13-Debian-3, mixed mode, sharing, tiered, compressed oops, g1 gc, linux-amd64) [vm1] # Problematic frame: [vm1] # v ~BufferBlob::vtable chunks [vm1] # [vm1] # Core dump will be written. Default location: /home/geode/geode/geode-lucene/build/upgradeTest8/dunit/vm1/core [vm1] # [vm1] # An error report file with more information is saved as: [vm1] # /home/geode/geode/geode-lucene/build/upgradeTest8/dunit/vm1/hs_err_pid5176.log [vm3_v130] [info 2019/01/16 21:05:09.581 UTC <RMI TCP Connection(2)-172.17.0.45> tid=0x23] Received method: org.apache.geode.cache.lucene.LuceneSearchWithRollingUpgradeDUnit$10.run with 0 args on object: "execute: put" [vm1] Could not load hsdis-amd64.so; library not loadable; PrintAssembly is disabled [vm1] # [vm1] # If you would like to submit a bug report, please visit: [vm1] # http://bugreport.java.com/bugreport/crash.jsp [vm1] # {noformat} > CI Failure: > RollingUpgradeQueryReturnsCorrectResultsAfterClientAndServersAreRolledOverAllBucketsCreated.test[from_v1X0, > with reindex=false] > -------------------------------------------------------------------------------------------------------------------------------------------- > > Key: GEODE-6284 > URL: https://issues.apache.org/jira/browse/GEODE-6284 > Project: Geode > Issue Type: Bug > Affects Versions: 1.9.0 > Reporter: Ryan McMahon > Priority: Major > > > {noformat} > org.apache.geode.test.dunit.RMIException: While invoking > org.apache.geode.test.dunit.NamedRunnable.run in VM 1 running on Host > 34bae3263b09 with 4 VMs > at org.apache.geode.test.dunit.VM.executeMethodOnObject(VM.java:537) > at org.apache.geode.test.dunit.VM.invoke(VM.java:352) > at org.apache.geode.test.dunit.Invoke.invokeInEveryVM(Invoke.java:57) > at > org.apache.geode.test.dunit.internal.JUnit4DistributedTestCase.doTearDownDistributedTestCase(JUnit4DistributedTestCase.java:496) > at > org.apache.geode.test.dunit.internal.JUnit4DistributedTestCase.tearDownDistributedTestCase(JUnit4DistributedTestCase.java:484) > at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:566) > at > org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) > at > org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) > at > org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) > at > org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:33) > at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) > at org.junit.rules.RunRules.evaluate(RunRules.java:20) > at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) > at > org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) > at > org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) > at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) > at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) > at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) > at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) > at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) > at org.junit.runners.ParentRunner.run(ParentRunner.java:363) > at org.junit.runners.Suite.runChild(Suite.java:128) > at org.junit.runners.Suite.runChild(Suite.java:27) > at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) > at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) > at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) > at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) > at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) > at > org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) > at org.junit.runners.ParentRunner.run(ParentRunner.java:363) > at > org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.runTestClass(JUnitTestClassExecutor.java:110) > at > org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.execute(JUnitTestClassExecutor.java:58) > at > org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.execute(JUnitTestClassExecutor.java:38) > at > org.gradle.api.internal.tasks.testing.junit.AbstractJUnitTestClassProcessor.processTestClass(AbstractJUnitTestClassProcessor.java:66) > at > org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:51) > at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:566) > at > org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35) > at > org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24) > at > org.gradle.internal.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32) > at > org.gradle.internal.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93) > at com.sun.proxy.$Proxy2.processTestClass(Unknown Source) > at > org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:118) > at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:566) > at > org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35) > at > org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24) > at > org.gradle.internal.remote.internal.hub.MessageHubBackedObjectConnection$DispatchWrapper.dispatch(MessageHubBackedObjectConnection.java:175) > at > org.gradle.internal.remote.internal.hub.MessageHubBackedObjectConnection$DispatchWrapper.dispatch(MessageHubBackedObjectConnection.java:157) > at > org.gradle.internal.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:404) > at > org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:63) > at > org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:46) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) > at > org.gradle.internal.concurrent.ThreadFactoryImpl$ManagedThreadRunnable.run(ThreadFactoryImpl.java:55) > at java.lang.Thread.run(Thread.java:834) > Caused by: java.rmi.ConnectException: Connection refused to host: > 172.17.0.45; nested exception is: > java.net.ConnectException: Connection refused (Connection refused) > at sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:619) > at > sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:209) > at sun.rmi.transport.tcp.TCPChannel.newConnection(TCPChannel.java:196) > at sun.rmi.server.UnicastRef.invoke(UnicastRef.java:129) > at > java.rmi.server.RemoteObjectInvocationHandler.invokeRemoteMethod(RemoteObjectInvocationHandler.java:209) > at > java.rmi.server.RemoteObjectInvocationHandler.invoke(RemoteObjectInvocationHandler.java:161) > at com.sun.proxy.$Proxy40.executeMethodOnObject(Unknown Source) > at org.apache.geode.test.dunit.VM.executeMethodOnObject(VM.java:530) > ... 62 more > Caused by: java.net.ConnectException: Connection refused (Connection refused) > at java.net.PlainSocketImpl.socketConnect(Native Method) > at > java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:399) > at > java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:242) > at > java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:224) > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:403) > at java.net.Socket.connect(Socket.java:591) > at java.net.Socket.connect(Socket.java:540) > at java.net.Socket.<init>(Socket.java:436) > at java.net.Socket.<init>(Socket.java:213) > at > sun.rmi.transport.tcp.TCPDirectSocketFactory.createSocket(TCPDirectSocketFactory.java:40) > at sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:613) > ... 69 more > {noformat} > > [https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/UpgradeTestOpenJDK11/builds/298] > > > {code:java} > =============== Test Results URI ================= > > http://files.apachegeode-ci.info/builds/apache-develop-main/1.9.0-SNAPSHOT.0343/test-results/upgradeTest/1547673913/ > ========================================= > Test report artifacts from this job are available at: > http://files.apachegeode-ci.info/builds/apache-develop-main/1.9.0-SNAPSHOT.0343/test-artifacts/1547673913/upgradetestfiles-OpenJDK11-1.9.0-SNAPSHOT.0343.tgz > {code} > -- This message was sent by Atlassian JIRA (v7.6.3#76005)