[ https://jira.codehaus.org/browse/SUREFIRE-1132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=360551#comment-360551 ]
Alexander Ashitkin commented on SUREFIRE-1132: ---------------------------------------------- Let me dot i's regarding the build - the project is stable itself. ClassNotFound failures are sporadic and should not happen. We have nightly build job on master branch with single thread and there are no failures for several months on the same box with the 100% identical settings except -T. Our housekeeping does not touch jars in local repos so dependencies just cannot dissapear. The only environment specific issue - is high load on our build boxes. 100% cpu load is not unusual. If classpath resources are loaded with async timeouts - that is a very realistic point of failure. @Andreas Please recall oracle bug_id sorted by jdk6->jdk8 upgrade - that could be helpful for me. @Tibor {quote}Do you trigger the build with --fail-never or -fn ?{quote} no {quote}appears in the ordinal build as well: without -T... ?{quote} no {code}You should check if the dependency exists on your Nexus repo and check the dependency exists in the POM which has the compiling problems{code} not an issue - the project is correct, all dependenices are phisically present Regarding forked booter - i see 3 failures for last 16 hours with the same error (but in different modules): {code} 07:50:42 [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.18.1:test (default-test) on project another-server: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.18.1:test failed: There was an error in the forked process 07:50:48 [ERROR] java.lang.NoClassDefFoundError: org/custommonkey/xmlunit/DifferenceListener 07:50:48 [ERROR] at java.lang.Class.getDeclaredConstructors0(Native Method) 07:50:48 [ERROR] at java.lang.Class.privateGetDeclaredConstructors(Class.java:2532) 07:50:48 [ERROR] at java.lang.Class.getConstructor0(Class.java:2842) 07:50:48 [ERROR] at java.lang.Class.getConstructor(Class.java:1718) 07:50:48 [ERROR] at org.apache.maven.surefire.junit.PojoAndJUnit3Checker.isPojoTest(PojoAndJUnit3Checker.java:51) 07:50:48 [ERROR] at org.apache.maven.surefire.junit.PojoAndJUnit3Checker.accept(PojoAndJUnit3Checker.java:43) 07:50:48 [ERROR] at org.apache.maven.surefire.util.DefaultScanResult.applyFilter(DefaultScanResult.java:97) 07:50:48 [ERROR] at org.apache.maven.surefire.junit.JUnit3Provider.scanClassPath(JUnit3Provider.java:137) 07:50:48 [ERROR] at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:88) 07:50:48 [ERROR] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:203) 07:50:48 [ERROR] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:155) 07:50:48 [ERROR] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) 07:50:48 [ERROR] Caused by: java.lang.ClassNotFoundException: org.custommonkey.xmlunit.DifferenceListener 07:50:48 [ERROR] at java.net.URLClassLoader$1.run(URLClassLoader.java:366) 07:50:48 [ERROR] at java.net.URLClassLoader$1.run(URLClassLoader.java:355) 07:50:48 [ERROR] at java.security.AccessController.doPrivileged(Native Method) 07:50:48 [ERROR] at java.net.URLClassLoader.findClass(URLClassLoader.java:354) 07:50:48 [ERROR] at java.lang.ClassLoader.loadClass(ClassLoader.java:425) 07:50:48 [ERROR] at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) 07:50:48 [ERROR] at java.lang.ClassLoader.loadClass(ClassLoader.java:358) 07:50:48 [ERROR] ... 12 more 07:50:48 [ERROR] -> [Help 1] 07:50:48 org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.18.1:test (default-test) on project another-server: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.18.1:test failed: There was an error in the forked process 07:50:48 java.lang.NoClassDefFoundError: org/custommonkey/xmlunit/DifferenceListener 07:50:48 at java.lang.Class.getDeclaredConstructors0(Native Method) 07:50:48 at java.lang.Class.privateGetDeclaredConstructors(Class.java:2532) 07:50:48 at java.lang.Class.getConstructor0(Class.java:2842) 07:50:48 at java.lang.Class.getConstructor(Class.java:1718) 07:50:48 at org.apache.maven.surefire.junit.PojoAndJUnit3Checker.isPojoTest(PojoAndJUnit3Checker.java:51) 07:50:48 at org.apache.maven.surefire.junit.PojoAndJUnit3Checker.accept(PojoAndJUnit3Checker.java:43) 07:50:48 at org.apache.maven.surefire.util.DefaultScanResult.applyFilter(DefaultScanResult.java:97) 07:50:48 at org.apache.maven.surefire.junit.JUnit3Provider.scanClassPath(JUnit3Provider.java:137) 07:50:48 at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:88) 07:50:48 at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:203) 07:50:48 at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:155) 07:50:48 at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) 07:50:48 Caused by: java.lang.ClassNotFoundException: org.custommonkey.xmlunit.DifferenceListener 07:50:48 at java.net.URLClassLoader$1.run(URLClassLoader.java:366) 07:50:48 at java.net.URLClassLoader$1.run(URLClassLoader.java:355) 07:50:48 at java.security.AccessController.doPrivileged(Native Method) 07:50:48 at java.net.URLClassLoader.findClass(URLClassLoader.java:354) 07:50:48 at java.lang.ClassLoader.loadClass(ClassLoader.java:425) 07:50:48 at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) 07:50:48 at java.lang.ClassLoader.loadClass(ClassLoader.java:358) 07:50:48 ... 12 more 07:50:48 07:50:48 at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:224) 07:50:48 at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) 07:50:48 at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) 07:50:48 at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116) 07:50:48 at org.apache.maven.lifecycle.internal.builder.multithreaded.MultiThreadedBuilder$1.call(MultiThreadedBuilder.java:188) 07:50:48 at org.apache.maven.lifecycle.internal.builder.multithreaded.MultiThreadedBuilder$1.call(MultiThreadedBuilder.java:184) 07:50:48 at java.util.concurrent.FutureTask.run(FutureTask.java:262) 07:50:48 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) 07:50:48 at java.util.concurrent.FutureTask.run(FutureTask.java:262) 07:50:48 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) 07:50:48 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) 07:50:48 at java.lang.Thread.run(Thread.java:745) 07:50:48 Caused by: org.apache.maven.plugin.PluginExecutionException: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.18.1:test failed: There was an error in the forked process 07:50:48 java.lang.NoClassDefFoundError: org/custommonkey/xmlunit/DifferenceListener 07:50:48 at java.lang.Class.getDeclaredConstructors0(Native Method) 07:50:48 at java.lang.Class.privateGetDeclaredConstructors(Class.java:2532) 07:50:48 at java.lang.Class.getConstructor0(Class.java:2842) 07:50:48 at java.lang.Class.getConstructor(Class.java:1718) 07:50:48 at org.apache.maven.surefire.junit.PojoAndJUnit3Checker.isPojoTest(PojoAndJUnit3Checker.java:51) 07:50:48 at org.apache.maven.surefire.junit.PojoAndJUnit3Checker.accept(PojoAndJUnit3Checker.java:43) 07:50:48 at org.apache.maven.surefire.util.DefaultScanResult.applyFilter(DefaultScanResult.java:97) 07:50:48 at org.apache.maven.surefire.junit.JUnit3Provider.scanClassPath(JUnit3Provider.java:137) 07:50:48 at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:88) 07:50:48 at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:203) 07:50:48 at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:155) 07:50:48 at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) 07:50:48 Caused by: java.lang.ClassNotFoundException: org.custommonkey.xmlunit.DifferenceListener 07:50:48 at java.net.URLClassLoader$1.run(URLClassLoader.java:366) 07:50:48 at java.net.URLClassLoader$1.run(URLClassLoader.java:355) 07:50:48 at java.security.AccessController.doPrivileged(Native Method) 07:50:48 at java.net.URLClassLoader.findClass(URLClassLoader.java:354) 07:50:48 at java.lang.ClassLoader.loadClass(ClassLoader.java:425) 07:50:48 at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) 07:50:48 at java.lang.ClassLoader.loadClass(ClassLoader.java:358) 07:50:48 ... 12 more 07:50:48 07:50:48 at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:143) 07:50:48 at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208) 07:50:48 ... 11 more 07:50:48 Caused by: java.lang.RuntimeException: There was an error in the forked process 07:50:48 java.lang.NoClassDefFoundError: org/custommonkey/xmlunit/DifferenceListener 07:50:48 at java.lang.Class.getDeclaredConstructors0(Native Method) 07:50:48 at java.lang.Class.privateGetDeclaredConstructors(Class.java:2532) 07:50:48 at java.lang.Class.getConstructor0(Class.java:2842) 07:50:48 at java.lang.Class.getConstructor(Class.java:1718) 07:50:48 at org.apache.maven.surefire.junit.PojoAndJUnit3Checker.isPojoTest(PojoAndJUnit3Checker.java:51) 07:50:48 at org.apache.maven.surefire.junit.PojoAndJUnit3Checker.accept(PojoAndJUnit3Checker.java:43) 07:50:48 at org.apache.maven.surefire.util.DefaultScanResult.applyFilter(DefaultScanResult.java:97) 07:50:48 at org.apache.maven.surefire.junit.JUnit3Provider.scanClassPath(JUnit3Provider.java:137) 07:50:48 at org.apache.maven.surefire.junit.JUnit3Provider.invoke(JUnit3Provider.java:88) 07:50:48 at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:203) 07:50:48 at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:155) 07:50:48 at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) 07:50:48 Caused by: java.lang.ClassNotFoundException: org.custommonkey.xmlunit.DifferenceListener 07:50:48 at java.net.URLClassLoader$1.run(URLClassLoader.java:366) 07:50:48 at java.net.URLClassLoader$1.run(URLClassLoader.java:355) 07:50:48 at java.security.AccessController.doPrivileged(Native Method) 07:50:48 at java.net.URLClassLoader.findClass(URLClassLoader.java:354) 07:50:48 at java.lang.ClassLoader.loadClass(ClassLoader.java:425) 07:50:48 at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) 07:50:48 at java.lang.ClassLoader.loadClass(ClassLoader.java:358) 07:50:48 ... 12 more 07:50:48 07:50:48 at org.apache.maven.plugin.surefire.booterclient.ForkStarter.fork(ForkStarter.java:509) 07:50:48 at org.apache.maven.plugin.surefire.booterclient.ForkStarter.fork(ForkStarter.java:380) 07:50:48 at org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:167) 07:50:48 at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:990) 07:50:48 at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:824) 07:50:48 at org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:722) 07:50:48 at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132) 07:50:48 ... 12 more 07:50:48 [ERROR] 07:50:48 [ERROR] Re-run Maven using the -X switch to enable full debug logging. 07:50:48 [ERROR] 07:50:48 [ERROR] For more information about the errors and possible solutions, please read the following articles: 07:50:48 [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException 07:50:48 [ERROR] 07:50:48 [ERROR] After correcting the problems, you can resume the build with the command 07:50:48 [ERROR] mvn <goals> -rf :another-server {code} > Surefire: regular isolated classloader failures in parallelbuild > ---------------------------------------------------------------- > > Key: SUREFIRE-1132 > URL: https://jira.codehaus.org/browse/SUREFIRE-1132 > Project: Maven Surefire > Issue Type: Bug > Components: classloading > Affects Versions: 2.17 > Environment: SLES 3.0.80-0.7-default SMP x86_64 GNU/Linux > windows server 2008 x64 > Maven 3.2.2, 3.2.3, 3.2.5 > Oracle HotSpot JDK 7u25 > Reporter: Alexander Ashitkin > Attachments: consoleText-1.txt, consoleText-2.txt, consoleText-3.txt > > > We have a large project of 300+ modules which regularly fails with different > kind of classloading issues in different places in surefire plugin. The issue > is reproduced only with parallel build and is not reproduced in single > threaded. This is a main contributor in build instability for us. All the not > loaded dependnecies are actually present in dependency tree. I attached 3 > different samples of how build fails. > Surefire config: > {code} > <configuration> > <forkCount>0</forkCount> > <!--doesnt work in parrallel build. Causes build > failures with error java.io.IOException: Stream Closed--> > <redirectTestOutputToFile>false</redirectTestOutputToFile> > <useManifestOnlyJar>false</useManifestOnlyJar> > </configuration> > {code} > maven cmd is like install -T 10 > Please advise how to sort this out - ready to run any provided diagnostic > and evaluate any options. > Thanks in advance, Alexander -- This message was sent by Atlassian JIRA (v6.1.6#6162)