[
https://issues.apache.org/jira/browse/SUREFIRE-1255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15341686#comment-15341686
]
Maximilian Michels commented on SUREFIRE-1255:
----------------------------------------------
Here you see the typical pattern. Tests are executing fine, then a random test
gets stuck before it even starts executing:
{noformat}
================================================================================
Test
testSubmissionOfExternalLibraryStream(org.apache.flink.api.scala.ScalaShellITCase)
is running.
--------------------------------------------------------------------------------
21:31:56,862 INFO
org.apache.flink.streaming.api.environment.RemoteStreamEnvironment - Running
remotely at localhost:1424
21:31:56,862 INFO org.apache.flink.client.program.Client
- Starting client actor system
21:31:56,862 INFO org.apache.flink.runtime.client.JobClient
- Starting JobClient actor system
21:31:56,918 INFO akka.event.slf4j.Slf4jLogger
- Slf4jLogger started
21:31:56,921 INFO Remoting
- Starting remoting
21:31:56,993 INFO Remoting
- Remoting started; listening on addresses :[akka.tcp://[email protected]:59787]
21:31:56,993 INFO org.apache.flink.runtime.client.JobClient
- Started JobClient actor system at 127.0.0.1:59787
21:31:56,995 INFO org.apache.flink.runtime.client.JobClientActor
- Received job Flink Streaming Job (ba6313ed8087fd58a3b44a4e34f7da09).
21:31:56,995 INFO org.apache.flink.runtime.client.JobClientActor
- Could not submit job Flink Streaming Job (ba6313ed8087fd58a3b44a4e34f7da09),
because there is no connection to a JobManager.
21:31:56,995 INFO org.apache.flink.runtime.client.JobClientActor
- Disconnect from JobManager null.
21:31:57,008 INFO org.apache.flink.runtime.client.JobClientActor
- Connect to JobManager
Actor[akka.tcp://[email protected]:1424/user/jobmanager#1798986522].
21:31:57,008 INFO org.apache.flink.runtime.client.JobClientActor
- Connected to new JobManager akka.tcp://[email protected]:1424/user/jobmanager.
21:31:57,008 INFO org.apache.flink.runtime.client.JobClientActor
- Sending message to JobManager
akka.tcp://[email protected]:1424/user/jobmanager to submit job Flink Streaming
Job (ba6313ed8087fd58a3b44a4e34f7da09) and wait for progress
21:31:57,008 INFO org.apache.flink.runtime.client.JobClientActor
- Upload jar files to job manager
akka.tcp://[email protected]:1424/user/jobmanager.
21:31:57,127 INFO org.apache.flink.runtime.client.JobClientActor
- Submit job to the job manager
akka.tcp://[email protected]:1424/user/jobmanager.
21:31:57,130 INFO org.apache.flink.runtime.testingUtils.TestingJobManager
- Submitting job ba6313ed8087fd58a3b44a4e34f7da09 (Flink Streaming Job).
21:31:57,130 INFO org.apache.flink.runtime.testingUtils.TestingJobManager
- Using restart strategy NoRestartStrategy for
ba6313ed8087fd58a3b44a4e34f7da09.
21:31:57,131 INFO org.apache.flink.runtime.testingUtils.TestingJobManager
- Scheduling job ba6313ed8087fd58a3b44a4e34f7da09 (Flink Streaming Job).
21:31:57,131 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph
- Source: Collection Source (1/1) (05e4a1a2aac913e21403948a73999abd) switched
from CREATED to SCHEDULED
21:31:57,131 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph
- Source: Collection Source (1/1) (05e4a1a2aac913e21403948a73999abd) switched
from SCHEDULED to DEPLOYING
21:31:57,131 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph
- Deploying Source: Collection Source (1/1) (attempt #0) to localhost
21:31:57,131 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph
- Sink: Unnamed (1/1) (620938fe6383b7b496076ee3678677e4) switched from CREATED
to SCHEDULED
21:31:57,131 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph
- Sink: Unnamed (1/1) (620938fe6383b7b496076ee3678677e4) switched from
SCHEDULED to DEPLOYING
21:31:57,131 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph
- Deploying Sink: Unnamed (1/1) (attempt #0) to localhost
21:31:57,137 INFO org.apache.flink.runtime.testingUtils.TestingJobManager
- Status of job ba6313ed8087fd58a3b44a4e34f7da09 (Flink Streaming Job) changed
to RUNNING.
21:31:57,139 INFO org.apache.flink.runtime.client.JobClientActor
- Job was successfully submitted to the JobManager
akka.tcp://[email protected]:1424/user/jobmanager.
21:31:57,139 INFO org.apache.flink.runtime.client.JobClientActor
- 06/12/2016 21:31:57 Job execution switched to status RUNNING.
21:31:57,139 INFO org.apache.flink.runtime.client.JobClientActor
- 06/12/2016 21:31:57 Source: Collection Source(1/1) switched to SCHEDULED
21:31:57,140 INFO org.apache.flink.runtime.client.JobClientActor
- 06/12/2016 21:31:57 Source: Collection Source(1/1) switched to DEPLOYING
21:31:57,141 INFO org.apache.flink.runtime.testingUtils.TestingTaskManager
- Received task Source: Collection Source (1/1)
21:31:57,141 INFO org.apache.flink.runtime.client.JobClientActor
- 06/12/2016 21:31:57 Sink: Unnamed(1/1) switched to SCHEDULED
21:31:57,141 INFO org.apache.flink.runtime.client.JobClientActor
- 06/12/2016 21:31:57 Sink: Unnamed(1/1) switched to DEPLOYING
21:31:57,149 INFO org.apache.flink.runtime.testingUtils.TestingTaskManager
- Received task Sink: Unnamed (1/1)
21:31:57,150 INFO org.apache.flink.runtime.taskmanager.Task
- Loading JAR files for task Source: Collection Source (1/1)
21:31:57,150 INFO org.apache.flink.runtime.blob.BlobCache
- Downloading e97cd16fe1aa31fb46ea320d91d8dc72490bea27 from /127.0.0.1:35146
21:31:57,160 INFO org.apache.flink.runtime.taskmanager.Task
- Loading JAR files for task Sink: Unnamed (1/1)
21:31:57,170 INFO org.apache.flink.runtime.taskmanager.Task
- Registering task at network: Source: Collection Source (1/1) [DEPLOYING]
21:31:57,171 INFO org.apache.flink.runtime.taskmanager.Task
- Registering task at network: Sink: Unnamed (1/1) [DEPLOYING]
21:31:57,171 INFO org.apache.flink.runtime.taskmanager.Task
- Source: Collection Source (1/1) switched to RUNNING
21:31:57,172 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph
- Source: Collection Source (1/1) (05e4a1a2aac913e21403948a73999abd) switched
from DEPLOYING to RUNNING
21:31:57,173 INFO org.apache.flink.runtime.client.JobClientActor
- 06/12/2016 21:31:57 Source: Collection Source(1/1) switched to RUNNING
21:31:57,186 INFO org.apache.flink.runtime.taskmanager.Task
- Sink: Unnamed (1/1) switched to RUNNING
21:31:57,187 WARN org.apache.flink.streaming.runtime.tasks.StreamTask
- No state backend has been specified, using default state backend (Memory /
JobManager)
21:31:57,187 INFO org.apache.flink.streaming.runtime.tasks.StreamTask
- State backend is set to heap memory (checkpoint to jobmanager)
21:31:57,188 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph
- Sink: Unnamed (1/1) (620938fe6383b7b496076ee3678677e4) switched from
DEPLOYING to RUNNING
21:31:57,188 WARN org.apache.flink.streaming.runtime.tasks.StreamTask
- No state backend has been specified, using default state backend (Memory /
JobManager)
21:31:57,188 INFO org.apache.flink.streaming.runtime.tasks.StreamTask
- State backend is set to heap memory (checkpoint to jobmanager)
21:31:57,208 INFO org.apache.flink.runtime.client.JobClientActor
- 06/12/2016 21:31:57 Sink: Unnamed(1/1) switched to RUNNING
21:31:57,222 INFO org.apache.flink.runtime.taskmanager.Task
- Sink: Unnamed (1/1) switched to FINISHED
21:31:57,223 INFO org.apache.flink.runtime.taskmanager.Task
- Freeing task resources for Sink: Unnamed (1/1)
21:31:57,224 INFO org.apache.flink.runtime.testingUtils.TestingTaskManager
- Un-registering task and sending final execution state FINISHED to JobManager
for task Sink: Unnamed (620938fe6383b7b496076ee3678677e4)
21:31:57,225 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph
- Sink: Unnamed (1/1) (620938fe6383b7b496076ee3678677e4) switched from RUNNING
to FINISHED
21:31:57,225 INFO org.apache.flink.runtime.client.JobClientActor
- 06/12/2016 21:31:57 Sink: Unnamed(1/1) switched to FINISHED
21:31:57,227 INFO org.apache.flink.runtime.taskmanager.Task
- Source: Collection Source (1/1) switched to FINISHED
21:31:57,227 INFO org.apache.flink.runtime.taskmanager.Task
- Freeing task resources for Source: Collection Source (1/1)
21:31:57,228 INFO org.apache.flink.runtime.testingUtils.TestingTaskManager
- Un-registering task and sending final execution state FINISHED to JobManager
for task Source: Collection Source (05e4a1a2aac913e21403948a73999abd)
21:31:57,228 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph
- Source: Collection Source (1/1) (05e4a1a2aac913e21403948a73999abd) switched
from RUNNING to FINISHED
21:31:57,232 INFO org.apache.flink.runtime.testingUtils.TestingJobManager
- Status of job ba6313ed8087fd58a3b44a4e34f7da09 (Flink Streaming Job) changed
to FINISHED.
21:31:57,241 INFO org.apache.flink.runtime.client.JobClientActor
- 06/12/2016 21:31:57 Source: Collection Source(1/1) switched to FINISHED
21:31:57,241 INFO org.apache.flink.runtime.client.JobClientActor
- Terminate JobClientActor.
21:31:57,241 INFO org.apache.flink.runtime.client.JobClientActor
- Disconnect from JobManager
Actor[akka.tcp://[email protected]:1424/user/jobmanager#1798986522].
21:31:57,242 INFO org.apache.flink.runtime.client.JobClientActor
- 06/12/2016 21:31:57 Job execution switched to status FINISHED.
21:31:57,242 INFO org.apache.flink.runtime.client.JobClient
- Job execution complete
21:31:57,244 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator
- Shutting down remote daemon.
21:31:57,244 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator
- Remote daemon shut down; proceeding with flushing remote transports.
21:31:57,252 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator
- Remoting shut down.
21:31:57,282 INFO org.apache.flink.api.scala.ScalaShellITCase
-
--------------------------------------------------------------------------------
Test
testSubmissionOfExternalLibraryStream(org.apache.flink.api.scala.ScalaShellITCase)
successfully run.
================================================================================
21:31:57,282 INFO org.apache.flink.api.scala.ScalaShellITCase
-
================================================================================
Test testPreventRecreationBatch(org.apache.flink.api.scala.ScalaShellITCase) is
running.
--------------------------------------------------------------------------------
{noformat}
> Surefire 2.19.1 hangs before starting test execution
> ----------------------------------------------------
>
> Key: SUREFIRE-1255
> URL: https://issues.apache.org/jira/browse/SUREFIRE-1255
> Project: Maven Surefire
> Issue Type: Bug
> Components: Maven Surefire Plugin, process forking
> Affects Versions: 2.19.1
> Reporter: Maximilian Michels
> Priority: Critical
>
> Seeing the same error as SUREFIRE-1193 in Apache Flink builds after upgrading
> from 2.18.1 to 2.19.1. No errors, builds just gets stuck at the beginning of
> tests with no log output from the test itself, e.g.
> https://s3.amazonaws.com/archive.travis-ci.org/jobs/137118454/log.txt
> After a couple of minutes Surefire reports
> {noformat}
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test
> (integration-tests) on project flink-scala-shell_2.10: ExecutionException The
> forked VM terminated without properly saying goodbye. VM crash or System.exit
> called?
> [ERROR] Command was /bin/sh -c cd
> /home/travis/build/mxm/flink/flink-scala-shell/target &&
> /usr/lib/jvm/java-8-oracle/jre/bin/java -Xms256m -Xmx800m -Dmvn.forkNumber=1
> -XX:-UseGCOverheadLimit -jar
> /home/travis/build/mxm/flink/flink-scala-shell/target/surefire/surefirebooter372520169616801479.jar
>
> /home/travis/build/mxm/flink/flink-scala-shell/target/surefire/surefire8229439069544382018tmp
>
> /home/travis/build/mxm/flink/flink-scala-shell/target/surefire/surefire_26373613144387982724tmp
> [ERROR] -> [Help 1]
> {noformat}
> We have a a couple of test classes that suffer from this problem. Tests don't
> read from STDIN or replace it. Switching back to 2.18.1 eliminates the
> problem (Ran over 100 builds). It seems to be a race condition because it
> only occurs every once in a while, i.e. ~ 2 out of 10 builds on Travis. I
> haven't been able to reproduce the problem locally.
> More logs:
> https://s3.amazonaws.com/flink-logs-us/travis-artifacts/mxm/flink/849/849.1.tar.gz
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)