[
https://issues.apache.org/jira/browse/HADOOP-16203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16843858#comment-16843858
]
Steve Loughran commented on HADOOP-16203:
-----------------------------------------
more detailed listing. The output of a a previous test case in the same file is
surfacing.
{code}
[ERROR] Failures:
[ERROR]
ITestS3AContractGetFileStatusV1List>AbstractContractGetFileStatusTest.testListLocatedStatusEmptyDirectory:132->Assert.assertEquals:645->Assert.failNotEquals:834->Assert.fail:88
listLocatedStatus(test dir): directory count in 2 directories and 0 files
expected:<1> but was:<2>
[ERROR]
ITestS3AContractGetFileStatusV1List>AbstractContractGetFileStatusTest.testListLocatedStatusFiltering:490->AbstractContractGetFileStatusTest.verifyListStatus:525->Assert.assertEquals:645->Assert.failNotEquals:834->Assert.fail:88
length of listStatus(s3a://hwdev-steve-ireland-new/fork-0009/test,
org.apache.hadoop.fs.contract.AbstractContractGetFileStatusTest$AllPathsFilter@48c57156
) [S3AFileStatus{path=s3a://hwdev-steve-ireland-new/fork-0009/test/file-2.txt;
isDirectory=false; length=0; replication=1; blocksize=33554432;
modification_time=1558300045000; access_time=0; owner=stevel; group=stevel;
permission=rw-rw-rw-; isSymlink=false; hasAcl=false; isEncrypted=true;
isErasureCoded=false} isEmptyDirectory=FALSE eTag=null versionId=null,
S3AFileStatus{path=s3a://hwdev-steve-ireland-new/fork-0009/test/file-1.txt;
isDirectory=false; length=0; replication=1; blocksize=33554432;
modification_time=1558300045000; access_time=0; owner=stevel; group=stevel;
permission=rw-rw-rw-; isSymlink=false; hasAcl=false; isEncrypted=true;
isErasureCoded=false} isEmptyDirectory=FALSE eTag=null versionId=null,
S3AFileStatus{path=s3a://hwdev-steve-ireland-new/fork-0009/test/ITestS3AContractDistCp;
isDirectory=true; modification_time=0; access_time=0; owner=stevel;
group=stevel; permission=rwxrwxrwx; isSymlink=false; hasAcl=false;
isEncrypted=true; isErasureCoded=false} isEmptyDirectory=UNKNOWN eTag=null
versionId=null] expected:<2> but was:<3>
[ERROR] Errors:
[ERROR] ITestS3ASSL.testOpenSSL:43 » UnsatisfiedLink
org.apache.hadoop.util.NativeCode...
[ERROR]
ITestS3GuardToolDynamoDB>AbstractS3GuardToolTestBase.testBucketInfoUnguarded:342
» FileNotFound
[INFO]
{code}
Problem is the test base is being listed, so list inconsistencies can surface.
the base contract test suite needs to create an empty dir for listing
> ITestS3AContractGetFileStatusV1List may have consistency issues
> ---------------------------------------------------------------
>
> Key: HADOOP-16203
> URL: https://issues.apache.org/jira/browse/HADOOP-16203
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Affects Versions: 3.3.0
> Reporter: Steve Loughran
> Priority: Minor
>
> Seeing in a failure in the listing tests which looks like it could suffer
> from some consistency/concurrency issues: the path used is chosen from the
> method name, but with two subclasses of the
> {{AbstractContractGetFileStatusTest}} suite, the S3A tests could be
> interfering.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
