I'm on CIO duty today. There have been some network issues over the last 24h and all of the hangs in the CIO dashboard corresponded with network failures. The jobs have been kicked off again, so hopefully we won't see this issues again for a while.
Are you consistently seeing these hangs in the PR pipeline? On Wed, Aug 7, 2019 at 9:50 AM Murtuza Boxwala <mboxw...@pivotal.io> wrote: > Yea. I think it might be a red herring, because I am seeing those errors > in every run, passing ones two…just double checked on > https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/UnitTestOpenJDK11/builds/948 > < > https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/UnitTestOpenJDK11/builds/948 > > > > If we don’t have any other ideas, though, it might be worth removing them. > > It is odd that you don’t see them locally. Let me see if I can get them to > show up…it might have something to do with the logging level. > > > On Aug 7, 2019, at 12:45 PM, Kirk Lund <kl...@apache.org> wrote: > > > > I don't know if the PowerMock warnings are related but that's the only > > thing interesting in the output before "timeout exceeded". > > > > On Wed, Aug 7, 2019 at 9:43 AM Murtuza Boxwala <mboxw...@pivotal.io> > wrote: > > > >> How down know these warnings are related to the builds hanging. When I > >> was on CIO duty a couple days ago, I remember seeing this warning in a > >> failing build, but then I looked back at passing builds on saw this as > well. > >> > >>> On Aug 7, 2019, at 12:40 PM, Kirk Lund <kl...@apache.org> wrote: > >>> > >>> The build is broken in CI right now (for main CI and PRs). The UnitTest > >>> jobs are timing out so I assume there's a hang of some sort. > >>> > >>> The WARNINGs appear to be related to PowerMock and begins with "An > >> illegal > >>> reflective access operation" in geode-assembly:test. > >>> > >>> I'm running unit tests locally and haven't hit this yet, but maybe we > >>> should consider disabling all PowerMock tests and increase priority on > >>> re-enabling them without PowerMock? > >>> > >>>> Task :geode-assembly:test > >>> WARNING: An illegal reflective access operation has occurred > >>> WARNING: Illegal reflective access by > >>> org.mockito.internal.util.reflection.AccessibilityChanger > >>> > >> > (file:/home/geode/.gradle/caches/modules-2/files-2.1/org.mockito/mockito-core/2.23.0/497ddb32fd5d01f9dbe99a2ec790aeb931dff1b1/mockito-core-2.23.0.jar) > >>> to field java.io.File.path > >>> WARNING: Please consider reporting this to the maintainers of > >>> org.mockito.internal.util.reflection.AccessibilityChanger > >>> WARNING: Use --illegal-access=warn to enable warnings of further > illegal > >>> reflective access operations > >>> WARNING: All illegal access operations will be denied in a future > release > >>> WARNING: An illegal reflective access operation has occurred > >>> WARNING: Illegal reflective access by > >>> org.mockito.internal.util.reflection.AccessibilityChanger > >>> > >> > (file:/home/geode/.gradle/caches/modules-2/files-2.1/org.mockito/mockito-core/2.23.0/497ddb32fd5d01f9dbe99a2ec790aeb931dff1b1/mockito-core-2.23.0.jar) > >>> to field java.io.File.path > >>> WARNING: Please consider reporting this to the maintainers of > >>> org.mockito.internal.util.reflection.AccessibilityChanger > >>> WARNING: Use --illegal-access=warn to enable warnings of further > illegal > >>> reflective access operations > >>> WARNING: All illegal access operations will be denied in a future > release > >>> > >>>> Task :geode-core:test > >>> WARNING: An illegal reflective access operation has occurred > >>> WARNING: Illegal reflective access by > >>> org.apache.geode.distributed.internal.deadlock.UnsafeThreadLocal > >>> (file:/home/geode/geode/geode-core/build/classes/java/main/) to method > >>> java.lang.ThreadLocal.getMap(java.lang.Thread) > >>> WARNING: Please consider reporting this to the maintainers of > >>> org.apache.geode.distributed.internal.deadlock.UnsafeThreadLocal > >>> WARNING: Use --illegal-access=warn to enable warnings of further > illegal > >>> reflective access operations > >>> WARNING: All illegal access operations will be denied in a future > release > >>> WARNING: An illegal reflective access operation has occurred > >>> WARNING: Illegal reflective access by > >>> org.mockito.internal.util.reflection.AccessibilityChanger > >>> > >> > (file:/home/geode/.gradle/caches/modules-2/files-2.1/org.mockito/mockito-core/2.23.0/497ddb32fd5d01f9dbe99a2ec790aeb931dff1b1/mockito-core-2.23.0.jar) > >>> to field java.util.Date.fastTime > >>> WARNING: Please consider reporting this to the maintainers of > >>> org.mockito.internal.util.reflection.AccessibilityChanger > >>> WARNING: Use --illegal-access=warn to enable warnings of further > illegal > >>> reflective access operations > >>> WARNING: All illegal access operations will be denied in a future > release > >>> WARNING: An illegal reflective access operation has occurred > >>> WARNING: Illegal reflective access by > >>> org.powermock.reflect.internal.WhiteboxImpl > >>> > >> > (file:/home/geode/.gradle/caches/modules-2/files-2.1/org.powermock/powermock-reflect/2.0.0-beta.5/4ea415348f15620783a1f26343d6732adfa86bc8/powermock-reflect-2.0.0-beta.5.jar) > >>> to method java.lang.Object.finalize() > >>> WARNING: Please consider reporting this to the maintainers of > >>> org.powermock.reflect.internal.WhiteboxImpl > >>> WARNING: Use --illegal-access=warn to enable warnings of further > illegal > >>> reflective access operations > >>> WARNING: All illegal access operations will be denied in a future > release > >>> WARNING: An illegal reflective access operation has occurred > >>> WARNING: Illegal reflective access by > >>> org.junit.contrib.java.lang.system.EnvironmentVariables > >>> > >> > (file:/home/geode/.gradle/caches/modules-2/files-2.1/com.github.stefanbirkner/system-rules/1.19.0/d541c9a1cff0dda32e2436c74562e2e4aa6c88cd/system-rules-1.19.0.jar) > >>> to field java.util.Collections$UnmodifiableMap.m > >>> WARNING: Please consider reporting this to the maintainers of > >>> org.junit.contrib.java.lang.system.EnvironmentVariables > >>> WARNING: Use --illegal-access=warn to enable warnings of further > illegal > >>> reflective access operations > >>> WARNING: All illegal access operations will be denied in a future > release > >>> > >>> timeout exceeded > >> > >> > >
