[
https://issues.apache.org/jira/browse/HADOOP-13614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15523919#comment-15523919
]
Chris Nauroth commented on HADOOP-13614:
----------------------------------------
Patch 002 looks good to me. Something failed in the Docker build during the
last pre-commit, so I submitted a new pre-commit run. That will show up here
once a Jenkins host frees up:
https://builds.apache.org/job/PreCommit-HADOOP-Build/10596/
bq. one thing to note here is that lots of tests appear to be running twice...
Thanks for sharing the test output. I see this is the command you ran:
{code}
mvn -T 1C integration-test -Pparallel-tests -DtestsThreadCount=4
{code}
There is an unfortunate Maven limitation between failsafe, use of automatically
triggered profiles (e.g. {{tests-off}} vs. {{tests-on}}) and manual activation
of profiles with the {{-P}} option. The only workaround I'm aware of is to
switch to activation by presence of a property and avoid activation via {{-P}}.
This is why during the integration test split, I added support for enabling
parallel tests by {{-Dparallel-tests}} and updated documentation to change all
occurrences of {{-Pparallel-tests}} to {{-Dparallel-tests}}.
> Purge some superfluous/obsolete S3 FS tests that are slowing test runs down
> ---------------------------------------------------------------------------
>
> Key: HADOOP-13614
> URL: https://issues.apache.org/jira/browse/HADOOP-13614
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3, test
> Affects Versions: 2.9.0
> Reporter: Steve Loughran
> Assignee: Steve Loughran
> Priority: Minor
> Attachments: HADOOP-13614-branch-2-001.patch,
> HADOOP-13614-branch-2-002.patch, HADOOP-13614-branch-2-002.patch, testrun.txt
>
>
> Some of the slow test cases contain tests that are now obsoleted by newer
> ones. For example, {{ITestS3ADeleteManyFiles}} has the test case
> {{testOpenCreate()}} which writes then reads files up 25 MB.
> Have a look at which of the s3a tests are taking time, review them to see if
> newer tests have superceded the slow ones; and cut them where appropriate.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
