[ 
https://issues.apache.org/jira/browse/SUREFIRE-1255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15341686#comment-15341686
 ] 

Maximilian Michels commented on SUREFIRE-1255:
----------------------------------------------

Here you see the typical pattern. Tests are executing fine, then a random test 
gets stuck before it even starts executing:

{noformat}
================================================================================
Test 
testSubmissionOfExternalLibraryStream(org.apache.flink.api.scala.ScalaShellITCase)
 is running.
--------------------------------------------------------------------------------
21:31:56,862 INFO  
org.apache.flink.streaming.api.environment.RemoteStreamEnvironment  - Running 
remotely at localhost:1424
21:31:56,862 INFO  org.apache.flink.client.program.Client                       
 - Starting client actor system
21:31:56,862 INFO  org.apache.flink.runtime.client.JobClient                    
 - Starting JobClient actor system
21:31:56,918 INFO  akka.event.slf4j.Slf4jLogger                                 
 - Slf4jLogger started
21:31:56,921 INFO  Remoting                                                     
 - Starting remoting
21:31:56,993 INFO  Remoting                                                     
 - Remoting started; listening on addresses :[akka.tcp://[email protected]:59787]
21:31:56,993 INFO  org.apache.flink.runtime.client.JobClient                    
 - Started JobClient actor system at 127.0.0.1:59787
21:31:56,995 INFO  org.apache.flink.runtime.client.JobClientActor               
 - Received job Flink Streaming Job (ba6313ed8087fd58a3b44a4e34f7da09).
21:31:56,995 INFO  org.apache.flink.runtime.client.JobClientActor               
 - Could not submit job Flink Streaming Job (ba6313ed8087fd58a3b44a4e34f7da09), 
because there is no connection to a JobManager.
21:31:56,995 INFO  org.apache.flink.runtime.client.JobClientActor               
 - Disconnect from JobManager null.
21:31:57,008 INFO  org.apache.flink.runtime.client.JobClientActor               
 - Connect to JobManager 
Actor[akka.tcp://[email protected]:1424/user/jobmanager#1798986522].
21:31:57,008 INFO  org.apache.flink.runtime.client.JobClientActor               
 - Connected to new JobManager akka.tcp://[email protected]:1424/user/jobmanager.
21:31:57,008 INFO  org.apache.flink.runtime.client.JobClientActor               
 - Sending message to JobManager 
akka.tcp://[email protected]:1424/user/jobmanager to submit job Flink Streaming 
Job (ba6313ed8087fd58a3b44a4e34f7da09) and wait for progress
21:31:57,008 INFO  org.apache.flink.runtime.client.JobClientActor               
 - Upload jar files to job manager 
akka.tcp://[email protected]:1424/user/jobmanager.
21:31:57,127 INFO  org.apache.flink.runtime.client.JobClientActor               
 - Submit job to the job manager 
akka.tcp://[email protected]:1424/user/jobmanager.
21:31:57,130 INFO  org.apache.flink.runtime.testingUtils.TestingJobManager      
 - Submitting job ba6313ed8087fd58a3b44a4e34f7da09 (Flink Streaming Job).
21:31:57,130 INFO  org.apache.flink.runtime.testingUtils.TestingJobManager      
 - Using restart strategy NoRestartStrategy for 
ba6313ed8087fd58a3b44a4e34f7da09.
21:31:57,131 INFO  org.apache.flink.runtime.testingUtils.TestingJobManager      
 - Scheduling job ba6313ed8087fd58a3b44a4e34f7da09 (Flink Streaming Job).
21:31:57,131 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       
 - Source: Collection Source (1/1) (05e4a1a2aac913e21403948a73999abd) switched 
from CREATED to SCHEDULED
21:31:57,131 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       
 - Source: Collection Source (1/1) (05e4a1a2aac913e21403948a73999abd) switched 
from SCHEDULED to DEPLOYING
21:31:57,131 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       
 - Deploying Source: Collection Source (1/1) (attempt #0) to localhost
21:31:57,131 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       
 - Sink: Unnamed (1/1) (620938fe6383b7b496076ee3678677e4) switched from CREATED 
to SCHEDULED
21:31:57,131 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       
 - Sink: Unnamed (1/1) (620938fe6383b7b496076ee3678677e4) switched from 
SCHEDULED to DEPLOYING
21:31:57,131 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       
 - Deploying Sink: Unnamed (1/1) (attempt #0) to localhost
21:31:57,137 INFO  org.apache.flink.runtime.testingUtils.TestingJobManager      
 - Status of job ba6313ed8087fd58a3b44a4e34f7da09 (Flink Streaming Job) changed 
to RUNNING.
21:31:57,139 INFO  org.apache.flink.runtime.client.JobClientActor               
 - Job was successfully submitted to the JobManager 
akka.tcp://[email protected]:1424/user/jobmanager.
21:31:57,139 INFO  org.apache.flink.runtime.client.JobClientActor               
 - 06/12/2016 21:31:57  Job execution switched to status RUNNING.
21:31:57,139 INFO  org.apache.flink.runtime.client.JobClientActor               
 - 06/12/2016 21:31:57  Source: Collection Source(1/1) switched to SCHEDULED 
21:31:57,140 INFO  org.apache.flink.runtime.client.JobClientActor               
 - 06/12/2016 21:31:57  Source: Collection Source(1/1) switched to DEPLOYING 
21:31:57,141 INFO  org.apache.flink.runtime.testingUtils.TestingTaskManager     
 - Received task Source: Collection Source (1/1)
21:31:57,141 INFO  org.apache.flink.runtime.client.JobClientActor               
 - 06/12/2016 21:31:57  Sink: Unnamed(1/1) switched to SCHEDULED 
21:31:57,141 INFO  org.apache.flink.runtime.client.JobClientActor               
 - 06/12/2016 21:31:57  Sink: Unnamed(1/1) switched to DEPLOYING 
21:31:57,149 INFO  org.apache.flink.runtime.testingUtils.TestingTaskManager     
 - Received task Sink: Unnamed (1/1)
21:31:57,150 INFO  org.apache.flink.runtime.taskmanager.Task                    
 - Loading JAR files for task Source: Collection Source (1/1)
21:31:57,150 INFO  org.apache.flink.runtime.blob.BlobCache                      
 - Downloading e97cd16fe1aa31fb46ea320d91d8dc72490bea27 from /127.0.0.1:35146
21:31:57,160 INFO  org.apache.flink.runtime.taskmanager.Task                    
 - Loading JAR files for task Sink: Unnamed (1/1)
21:31:57,170 INFO  org.apache.flink.runtime.taskmanager.Task                    
 - Registering task at network: Source: Collection Source (1/1) [DEPLOYING]
21:31:57,171 INFO  org.apache.flink.runtime.taskmanager.Task                    
 - Registering task at network: Sink: Unnamed (1/1) [DEPLOYING]
21:31:57,171 INFO  org.apache.flink.runtime.taskmanager.Task                    
 - Source: Collection Source (1/1) switched to RUNNING
21:31:57,172 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       
 - Source: Collection Source (1/1) (05e4a1a2aac913e21403948a73999abd) switched 
from DEPLOYING to RUNNING
21:31:57,173 INFO  org.apache.flink.runtime.client.JobClientActor               
 - 06/12/2016 21:31:57  Source: Collection Source(1/1) switched to RUNNING 
21:31:57,186 INFO  org.apache.flink.runtime.taskmanager.Task                    
 - Sink: Unnamed (1/1) switched to RUNNING
21:31:57,187 WARN  org.apache.flink.streaming.runtime.tasks.StreamTask          
 - No state backend has been specified, using default state backend (Memory / 
JobManager)
21:31:57,187 INFO  org.apache.flink.streaming.runtime.tasks.StreamTask          
 - State backend is set to heap memory (checkpoint to jobmanager)
21:31:57,188 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       
 - Sink: Unnamed (1/1) (620938fe6383b7b496076ee3678677e4) switched from 
DEPLOYING to RUNNING
21:31:57,188 WARN  org.apache.flink.streaming.runtime.tasks.StreamTask          
 - No state backend has been specified, using default state backend (Memory / 
JobManager)
21:31:57,188 INFO  org.apache.flink.streaming.runtime.tasks.StreamTask          
 - State backend is set to heap memory (checkpoint to jobmanager)
21:31:57,208 INFO  org.apache.flink.runtime.client.JobClientActor               
 - 06/12/2016 21:31:57  Sink: Unnamed(1/1) switched to RUNNING 
21:31:57,222 INFO  org.apache.flink.runtime.taskmanager.Task                    
 - Sink: Unnamed (1/1) switched to FINISHED
21:31:57,223 INFO  org.apache.flink.runtime.taskmanager.Task                    
 - Freeing task resources for Sink: Unnamed (1/1)
21:31:57,224 INFO  org.apache.flink.runtime.testingUtils.TestingTaskManager     
 - Un-registering task and sending final execution state FINISHED to JobManager 
for task Sink: Unnamed (620938fe6383b7b496076ee3678677e4)
21:31:57,225 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       
 - Sink: Unnamed (1/1) (620938fe6383b7b496076ee3678677e4) switched from RUNNING 
to FINISHED
21:31:57,225 INFO  org.apache.flink.runtime.client.JobClientActor               
 - 06/12/2016 21:31:57  Sink: Unnamed(1/1) switched to FINISHED 
21:31:57,227 INFO  org.apache.flink.runtime.taskmanager.Task                    
 - Source: Collection Source (1/1) switched to FINISHED
21:31:57,227 INFO  org.apache.flink.runtime.taskmanager.Task                    
 - Freeing task resources for Source: Collection Source (1/1)
21:31:57,228 INFO  org.apache.flink.runtime.testingUtils.TestingTaskManager     
 - Un-registering task and sending final execution state FINISHED to JobManager 
for task Source: Collection Source (05e4a1a2aac913e21403948a73999abd)
21:31:57,228 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       
 - Source: Collection Source (1/1) (05e4a1a2aac913e21403948a73999abd) switched 
from RUNNING to FINISHED
21:31:57,232 INFO  org.apache.flink.runtime.testingUtils.TestingJobManager      
 - Status of job ba6313ed8087fd58a3b44a4e34f7da09 (Flink Streaming Job) changed 
to FINISHED.
21:31:57,241 INFO  org.apache.flink.runtime.client.JobClientActor               
 - 06/12/2016 21:31:57  Source: Collection Source(1/1) switched to FINISHED 
21:31:57,241 INFO  org.apache.flink.runtime.client.JobClientActor               
 - Terminate JobClientActor.
21:31:57,241 INFO  org.apache.flink.runtime.client.JobClientActor               
 - Disconnect from JobManager 
Actor[akka.tcp://[email protected]:1424/user/jobmanager#1798986522].
21:31:57,242 INFO  org.apache.flink.runtime.client.JobClientActor               
 - 06/12/2016 21:31:57  Job execution switched to status FINISHED.
21:31:57,242 INFO  org.apache.flink.runtime.client.JobClient                    
 - Job execution complete
21:31:57,244 INFO  akka.remote.RemoteActorRefProvider$RemotingTerminator        
 - Shutting down remote daemon.
21:31:57,244 INFO  akka.remote.RemoteActorRefProvider$RemotingTerminator        
 - Remote daemon shut down; proceeding with flushing remote transports.
21:31:57,252 INFO  akka.remote.RemoteActorRefProvider$RemotingTerminator        
 - Remoting shut down.
21:31:57,282 INFO  org.apache.flink.api.scala.ScalaShellITCase                  
 - 
--------------------------------------------------------------------------------
Test 
testSubmissionOfExternalLibraryStream(org.apache.flink.api.scala.ScalaShellITCase)
 successfully run.
================================================================================
21:31:57,282 INFO  org.apache.flink.api.scala.ScalaShellITCase                  
 - 
================================================================================
Test testPreventRecreationBatch(org.apache.flink.api.scala.ScalaShellITCase) is 
running.
--------------------------------------------------------------------------------

{noformat}

> Surefire 2.19.1 hangs before starting test execution
> ----------------------------------------------------
>
>                 Key: SUREFIRE-1255
>                 URL: https://issues.apache.org/jira/browse/SUREFIRE-1255
>             Project: Maven Surefire
>          Issue Type: Bug
>          Components: Maven Surefire Plugin, process forking
>    Affects Versions: 2.19.1
>            Reporter: Maximilian Michels
>            Priority: Critical
>
> Seeing the same error as SUREFIRE-1193 in Apache Flink builds after upgrading 
> from 2.18.1 to 2.19.1. No errors, builds just gets stuck at the beginning of 
> tests with no log output from the test itself, e.g. 
> https://s3.amazonaws.com/archive.travis-ci.org/jobs/137118454/log.txt
> After a couple of minutes Surefire reports 
> {noformat}
> [ERROR] Failed to execute goal 
> org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test 
> (integration-tests) on project flink-scala-shell_2.10: ExecutionException The 
> forked VM terminated without properly saying goodbye. VM crash or System.exit 
> called?
> [ERROR] Command was /bin/sh -c cd 
> /home/travis/build/mxm/flink/flink-scala-shell/target && 
> /usr/lib/jvm/java-8-oracle/jre/bin/java -Xms256m -Xmx800m -Dmvn.forkNumber=1 
> -XX:-UseGCOverheadLimit -jar 
> /home/travis/build/mxm/flink/flink-scala-shell/target/surefire/surefirebooter372520169616801479.jar
>  
> /home/travis/build/mxm/flink/flink-scala-shell/target/surefire/surefire8229439069544382018tmp
>  
> /home/travis/build/mxm/flink/flink-scala-shell/target/surefire/surefire_26373613144387982724tmp
> [ERROR] -> [Help 1]
> {noformat}
> We have a a couple of test classes that suffer from this problem. Tests don't 
> read from STDIN or replace it. Switching back to 2.18.1 eliminates the 
> problem (Ran over 100 builds). It seems to be a race condition because it 
> only occurs every once in a while, i.e. ~ 2 out of 10 builds on Travis. I 
> haven't been able to reproduce the problem locally.
> More logs: 
> https://s3.amazonaws.com/flink-logs-us/travis-artifacts/mxm/flink/849/849.1.tar.gz



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to