[
https://issues.apache.org/jira/browse/HADOOP-17190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174248#comment-17174248
]
Steve Loughran commented on HADOOP-17190:
-----------------------------------------
[~mukund-thakur]are you seeing anything in the logs? There's a yarn cluster dir
under test/ where, somewhere in the many log files, the output of the terasort
AM is saved. See if you can find it and whether it prints anything exciting.
Does this only happen in parallel test runs? As that is how my last race
condition with speculative IO Surfaced
> ITestTerasortOnS3A.test_120_terasort failing
> --------------------------------------------
>
> Key: HADOOP-17190
> URL: https://issues.apache.org/jira/browse/HADOOP-17190
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs/s3
> Affects Versions: 3.3.0
> Reporter: Mukund Thakur
> Priority: Major
>
> [*INFO*] Running org.apache.hadoop.fs.s3a.commit.terasort.*ITestTerasortOnS3A*
> [*ERROR*] *Tests* *run: 14*, *Failures: 2*, Errors: 0, *Skipped: 2*, Time
> elapsed: 110.43 s *<<< FAILURE!* - in
> org.apache.hadoop.fs.s3a.commit.terasort.*ITestTerasortOnS3A*
> [*ERROR*]
> test_120_terasort[directory](org.apache.hadoop.fs.s3a.commit.terasort.ITestTerasortOnS3A)
> Time elapsed: 6.261 s <<< FAILURE!
> java.lang.AssertionError:
> terasort(s3a://mthakur-data/terasort-directory/sortin,
> s3a://mthakur-data/terasort-directory/sortout) failed expected:<0> but was:<1>
> at
> org.apache.hadoop.fs.s3a.commit.terasort.ITestTerasortOnS3A.executeStage(ITestTerasortOnS3A.java:241)
> at
> org.apache.hadoop.fs.s3a.commit.terasort.ITestTerasortOnS3A.test_120_terasort(ITestTerasortOnS3A.java:291)
>
> [*ERROR*]
> test_120_terasort[magic](org.apache.hadoop.fs.s3a.commit.terasort.ITestTerasortOnS3A)
> Time elapsed: 5.962 s <<< FAILURE!
> java.lang.AssertionError: terasort(s3a://mthakur-data/terasort-magic/sortin,
> s3a://mthakur-data/terasort-magic/sortout) failed expected:<0> but was:<1>
> at
> org.apache.hadoop.fs.s3a.commit.terasort.ITestTerasortOnS3A.executeStage(ITestTerasortOnS3A.java:241)
> at
> org.apache.hadoop.fs.s3a.commit.terasort.ITestTerasortOnS3A.test_120_terasort(ITestTerasortOnS3A.java:291)
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
