steveloughran commented on issue #802: HADOOP-16279. S3Guard: Implement time-based (TTL) expiry for entries … URL: https://github.com/apache/hadoop/pull/802#issuecomment-500409566 Got a fair few failures on the OOB tests on my run of the merged patch. This was with s3guard + dynamo, but not auth ``` [INFO] Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 39.02 s - in org.apache.hadoop.fs.s3a.select.ITestS3SelectLandsat [ERROR] Tests run: 20, Failures: 4, Errors: 4, Skipped: 0, Time elapsed: 183.22 s <<< FAILURE! - in org.apache.hadoop.fs.s3a.ITestS3GuardOutOfBandOperations [ERROR] testOutOfBandDeletes[0](org.apache.hadoop.fs.s3a.ITestS3GuardOutOfBandOperations) Time elapsed: 8.071 s <<< ERROR! java.util.concurrent.ExecutionException: java.io.FileNotFoundException: No such file or directory: s3a://hwdev-steve-ireland-new/fork-0007/test/OutOfBandDelete-ba80dd3b-0d53-4768-9be2-f7473c0c3afe at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357) at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1895) at org.apache.hadoop.fs.s3a.ITestS3GuardOutOfBandOperations.expectExceptionWhenReadingOpenFileAPI(ITestS3GuardOutOfBandOperations.java:902) at org.apache.hadoop.fs.s3a.ITestS3GuardOutOfBandOperations.outOfBandDeletes(ITestS3GuardOutOfBandOperations.java:597) at org.apache.hadoop.fs.s3a.ITestS3GuardOutOfBandOperations.testOutOfBandDeletes(ITestS3GuardOutOfBandOperations.java:267) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) Caused by: java.io.FileNotFoundException: No such file or directory: s3a://hwdev-steve-ireland-new/fork-0007/test/OutOfBandDelete-ba80dd3b-0d53-4768-9be2-f7473c0c3afe at org.apache.hadoop.fs.s3a.S3AFileSystem.s3GetFileStatus(S3AFileSystem.java:2660) at org.apache.hadoop.fs.s3a.S3AFileSystem.innerGetFileStatus(S3AFileSystem.java:2549) at org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus(S3AFileSystem.java:2450) at org.apache.hadoop.fs.s3a.S3AFileSystem.open(S3AFileSystem.java:899) at org.apache.hadoop.fs.s3a.S3AFileSystem.lambda$null$19(S3AFileSystem.java:3988) at org.apache.hadoop.util.LambdaUtils.eval(LambdaUtils.java:52) at org.apache.hadoop.fs.s3a.S3AFileSystem.lambda$openFileWithOptions$20(S3AFileSystem.java:3987) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ... 1 more [ERROR] testLongerLengthOverwrite[0](org.apache.hadoop.fs.s3a.ITestS3GuardOutOfBandOperations) Time elapsed: 24.282 s <<< FAILURE! java.lang.AssertionError: File length in authoritative table with Raw: S3AFileStatus{path=s3a://hwdev-steve-ireland-new/fork-0007/test/OverwriteFileTest-c68b356a-6d5e-4e3a-90ef-4bd1552d4175; isDirectory=false; length=27; replication=1; blocksize=33554432; modification_time=1560167320000; access_time=0; owner=stevel; group=stevel; permission=rw-rw-rw-; isSymlink=false; hasAcl=false; isEncrypted=true; isErasureCoded=false} isEmptyDirectory=FALSE eTag=fd902fb718bd01bcddabcd77a2e3d547 versionId=KGqiYuMuYDAuAejU6b.cAjgxERJ02nft Guarded: S3AFileStatus{path=s3a://hwdev-steve-ireland-new/fork-0007/test/OverwriteFileTest-c68b356a-6d5e-4e3a-90ef-4bd1552d4175; isDirectory=false; length=27; replication=1; blocksize=33554432; modification_time=1560167320000; access_time=0; owner=stevel; group=stevel; permission=rw-rw-rw-; isSymlink=false; hasAcl=false; isEncrypted=true; isErasureCoded=false} isEmptyDirectory=FALSE eTag=fd902fb718bd01bcddabcd77a2e3d547 versionId=KGqiYuMuYDAuAejU6b.cAjgxERJ02nft. Actual: 27 at org.junit.Assert.fail(Assert.java:88) at org.junit.Assert.failEquals(Assert.java:185) at org.junit.Assert.assertNotEquals(Assert.java:199) at org.apache.hadoop.fs.s3a.ITestS3GuardOutOfBandOperations.verifyFileStatusAsExpected(ITestS3GuardOutOfBandOperations.java:771) at org.apache.hadoop.fs.s3a.ITestS3GuardOutOfBandOperations.lambda$overwriteFile$4(ITestS3GuardOutOfBandOperations.java:631) at org.apache.hadoop.test.LambdaTestUtils$VoidCaller.call(LambdaTestUtils.java:985) at org.apache.hadoop.test.LambdaTestUtils$VoidCaller.call(LambdaTestUtils.java:976) at org.apache.hadoop.test.LambdaTestUtils.eventually(LambdaTestUtils.java:252) at org.apache.hadoop.test.LambdaTestUtils.eventually(LambdaTestUtils.java:304) at org.apache.hadoop.test.LambdaTestUtils.eventually(LambdaTestUtils.java:350) at org.apache.hadoop.fs.s3a.ITestS3GuardOutOfBandOperations.overwriteFile(ITestS3GuardOutOfBandOperations.java:626) at org.apache.hadoop.fs.s3a.ITestS3GuardOutOfBandOperations.testLongerLengthOverwrite(ITestS3GuardOutOfBandOperations.java:255) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) [ERROR] testListingSameLengthOverwrite[0](org.apache.hadoop.fs.s3a.ITestS3GuardOutOfBandOperations) Time elapsed: 25.874 s <<< FAILURE! java.lang.AssertionError: Authoritative is enabled, so metadata is not updated in ms, so mod_time won't match. Expecting different values for raw and guarded filestatus. Raw: S3AFileStatus{path=s3a://hwdev-steve-ireland-new/fork-0007/test/dir-c0edf4a8-d1c5-49aa-9ef2-f16a1879b458/file-1-c0edf4a8-d1c5-49aa-9ef2-f16a1879b458; isDirectory=false; length=8; replication=1; blocksize=33554432; modification_time=1560167345000; access_time=0; owner=stevel; group=stevel; permission=rw-rw-rw-; isSymlink=false; hasAcl=false; isEncrypted=true; isErasureCoded=false} isEmptyDirectory=FALSE eTag=9d54f4c0c77def4be7880a85991b04c5 versionId=.XH3.H.Oi1nYjNu3BhQa1k44rS7hqNJ8 Guarded: S3AFileStatus{path=s3a://hwdev-steve-ireland-new/fork-0007/test/dir-c0edf4a8-d1c5-49aa-9ef2-f16a1879b458/file-1-c0edf4a8-d1c5-49aa-9ef2-f16a1879b458; isDirectory=false; length=8; replication=1; blocksize=33554432; modification_time=1560167345000; access_time=0; owner=stevel; group=stevel; permission=rw-rw-rw-; isSymlink=false; hasAcl=false; isEncrypted=true; isErasureCoded=false} isEmptyDirectory=FALSE eTag=9d54f4c0c77def4be7880a85991b04c5 versionId=.XH3.H.Oi1nYjNu3BhQa1k44rS7hqNJ8. Actual: 1560167345000 at org.junit.Assert.fail(Assert.java:88) at org.junit.Assert.failEquals(Assert.java:185) at org.junit.Assert.assertNotEquals(Assert.java:199) at org.apache.hadoop.fs.s3a.ITestS3GuardOutOfBandOperations.verifyFileStatusAsExpected(ITestS3GuardOutOfBandOperations.java:790) at org.apache.hadoop.fs.s3a.ITestS3GuardOutOfBandOperations.lambda$overwriteFileInListing$5(ITestS3GuardOutOfBandOperations.java:720) at org.apache.hadoop.test.LambdaTestUtils$VoidCaller.call(LambdaTestUtils.java:985) at org.apache.hadoop.test.LambdaTestUtils$VoidCaller.call(LambdaTestUtils.java:976) at org.apache.hadoop.test.LambdaTestUtils.eventually(LambdaTestUtils.java:252) at org.apache.hadoop.test.LambdaTestUtils.eventually(LambdaTestUtils.java:304) at org.apache.hadoop.test.LambdaTestUtils.eventually(LambdaTestUtils.java:350) at org.apache.hadoop.fs.s3a.ITestS3GuardOutOfBandOperations.overwriteFileInListing(ITestS3GuardOutOfBandOperations.java:716) at org.apache.hadoop.fs.s3a.ITestS3GuardOutOfBandOperations.testListingSameLengthOverwrite(ITestS3GuardOutOfBandOperations.java:272) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) [ERROR] testListingDelete[0](org.apache.hadoop.fs.s3a.ITestS3GuardOutOfBandOperations) Time elapsed: 8.198 s <<< ERROR! java.util.concurrent.ExecutionException: java.io.FileNotFoundException: No such file or directory: s3a://hwdev-steve-ireland-new/fork-0007/test/dir-127ee17f-099d-453c-9d4a-48ddf8bef984/file-1-127ee17f-099d-453c-9d4a-48ddf8bef984 at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357) at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1895) at org.apache.hadoop.fs.s3a.ITestS3GuardOutOfBandOperations.expectExceptionWhenReadingOpenFileAPI(ITestS3GuardOutOfBandOperations.java:902) at org.apache.hadoop.fs.s3a.ITestS3GuardOutOfBandOperations.deleteFileInListing(ITestS3GuardOutOfBandOperations.java:870) at org.apache.hadoop.fs.s3a.ITestS3GuardOutOfBandOperations.testListingDelete(ITestS3GuardOutOfBandOperations.java:282) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) Caused by: java.io.FileNotFoundException: No such file or directory: s3a://hwdev-steve-ireland-new/fork-0007/test/dir-127ee17f-099d-453c-9d4a-48ddf8bef984/file-1-127ee17f-099d-453c-9d4a-48ddf8bef984 at org.apache.hadoop.fs.s3a.S3AFileSystem.s3GetFileStatus(S3AFileSystem.java:2660) at org.apache.hadoop.fs.s3a.S3AFileSystem.innerGetFileStatus(S3AFileSystem.java:2549) at org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus(S3AFileSystem.java:2450) at org.apache.hadoop.fs.s3a.S3AFileSystem.open(S3AFileSystem.java:899) at org.apache.hadoop.fs.s3a.S3AFileSystem.lambda$null$19(S3AFileSystem.java:3988) at org.apache.hadoop.util.LambdaUtils.eval(LambdaUtils.java:52) at org.apache.hadoop.fs.s3a.S3AFileSystem.lambda$openFileWithOptions$20(S3AFileSystem.java:3987) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ... 1 more [ERROR] testSameLengthOverwrite[0](org.apache.hadoop.fs.s3a.ITestS3GuardOutOfBandOperations) Time elapsed: 24.555 s <<< FAILURE! java.lang.AssertionError: Authoritative is enabled, so metadata is not updated in ms, so mod_time won't match. Expecting different values for raw and guarded filestatus. Raw: S3AFileStatus{path=s3a://hwdev-steve-ireland-new/fork-0007/test/OverwriteFileTest-07321ede-1fd0-4c86-9899-428ac8f64350; isDirectory=false; length=13; replication=1; blocksize=33554432; modification_time=1560167382000; access_time=0; owner=stevel; group=stevel; permission=rw-rw-rw-; isSymlink=false; hasAcl=false; isEncrypted=true; isErasureCoded=false} isEmptyDirectory=FALSE eTag=1f9bd06f0b9c061cb1079a2bc30ded89 versionId=o2dWJFA7csY_tHtqlwyuZw0Tue9jr6ex Guarded: S3AFileStatus{path=s3a://hwdev-steve-ireland-new/fork-0007/test/OverwriteFileTest-07321ede-1fd0-4c86-9899-428ac8f64350; isDirectory=false; length=13; replication=1; blocksize=33554432; modification_time=1560167382000; access_time=0; owner=stevel; group=stevel; permission=rw-rw-rw-; isSymlink=false; hasAcl=false; isEncrypted=true; isErasureCoded=false} isEmptyDirectory=FALSE eTag=1f9bd06f0b9c061cb1079a2bc30ded89 versionId=o2dWJFA7csY_tHtqlwyuZw0Tue9jr6ex. Actual: 1560167382000 at org.junit.Assert.fail(Assert.java:88) at org.junit.Assert.failEquals(Assert.java:185) at org.junit.Assert.assertNotEquals(Assert.java:199) at org.apache.hadoop.fs.s3a.ITestS3GuardOutOfBandOperations.verifyFileStatusAsExpected(ITestS3GuardOutOfBandOperations.java:790) at org.apache.hadoop.fs.s3a.ITestS3GuardOutOfBandOperations.lambda$overwriteFile$4(ITestS3GuardOutOfBandOperations.java:631) at org.apache.hadoop.test.LambdaTestUtils$VoidCaller.call(LambdaTestUtils.java:985) at org.apache.hadoop.test.LambdaTestUtils$VoidCaller.call(LambdaTestUtils.java:976) at org.apache.hadoop.test.LambdaTestUtils.eventually(LambdaTestUtils.java:252) at org.apache.hadoop.test.LambdaTestUtils.eventually(LambdaTestUtils.java:304) at org.apache.hadoop.test.LambdaTestUtils.eventually(LambdaTestUtils.java:350) at org.apache.hadoop.fs.s3a.ITestS3GuardOutOfBandOperations.overwriteFile(ITestS3GuardOutOfBandOperations.java:626) at org.apache.hadoop.fs.s3a.ITestS3GuardOutOfBandOperations.testSameLengthOverwrite(ITestS3GuardOutOfBandOperations.java:248) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) [ERROR] testListingLongerLengthOverwrite[0](org.apache.hadoop.fs.s3a.ITestS3GuardOutOfBandOperations) Time elapsed: 25.6 s <<< FAILURE! java.lang.AssertionError: File length in authoritative table with Raw: S3AFileStatus{path=s3a://hwdev-steve-ireland-new/fork-0007/test/dir-dbe6cf0c-b0e2-4b34-bccb-f4755675215b/file-1-dbe6cf0c-b0e2-4b34-bccb-f4755675215b; isDirectory=false; length=15; replication=1; blocksize=33554432; modification_time=1560167410000; access_time=0; owner=stevel; group=stevel; permission=rw-rw-rw-; isSymlink=false; hasAcl=false; isEncrypted=true; isErasureCoded=false} isEmptyDirectory=FALSE eTag=4e52748950e60c27b6c8fd79c9be5e5d versionId=MbKsfm33iPWNxRkIQIMGCTpkk1R8.bSh Guarded: S3AFileStatus{path=s3a://hwdev-steve-ireland-new/fork-0007/test/dir-dbe6cf0c-b0e2-4b34-bccb-f4755675215b/file-1-dbe6cf0c-b0e2-4b34-bccb-f4755675215b; isDirectory=false; length=15; replication=1; blocksize=33554432; modification_time=1560167410000; access_time=0; owner=stevel; group=stevel; permission=rw-rw-rw-; isSymlink=false; hasAcl=false; isEncrypted=true; isErasureCoded=false} isEmptyDirectory=FALSE eTag=4e52748950e60c27b6c8fd79c9be5e5d versionId=MbKsfm33iPWNxRkIQIMGCTpkk1R8.bSh. Actual: 15 at org.junit.Assert.fail(Assert.java:88) at org.junit.Assert.failEquals(Assert.java:185) at org.junit.Assert.assertNotEquals(Assert.java:199) at org.apache.hadoop.fs.s3a.ITestS3GuardOutOfBandOperations.verifyFileStatusAsExpected(ITestS3GuardOutOfBandOperations.java:771) at org.apache.hadoop.fs.s3a.ITestS3GuardOutOfBandOperations.lambda$overwriteFileInListing$5(ITestS3GuardOutOfBandOperations.java:720) at org.apache.hadoop.test.LambdaTestUtils$VoidCaller.call(LambdaTestUtils.java:985) at org.apache.hadoop.test.LambdaTestUtils$VoidCaller.call(LambdaTestUtils.java:976) at org.apache.hadoop.test.LambdaTestUtils.eventually(LambdaTestUtils.java:252) at org.apache.hadoop.test.LambdaTestUtils.eventually(LambdaTestUtils.java:304) at org.apache.hadoop.test.LambdaTestUtils.eventually(LambdaTestUtils.java:350) at org.apache.hadoop.fs.s3a.ITestS3GuardOutOfBandOperations.overwriteFileInListing(ITestS3GuardOutOfBandOperations.java:716) at org.apache.hadoop.fs.s3a.ITestS3GuardOutOfBandOperations.testListingLongerLengthOverwrite(ITestS3GuardOutOfBandOperations.java:277) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) [ERROR] testOutOfBandDeletes[1](org.apache.hadoop.fs.s3a.ITestS3GuardOutOfBandOperations) Time elapsed: 7.941 s <<< ERROR! java.util.concurrent.ExecutionException: java.io.FileNotFoundException: No such file or directory: s3a://hwdev-steve-ireland-new/fork-0007/test/OutOfBandDelete-977f5bc7-fb7e-498b-b4ab-0b7359ecc451 at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357) at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1895) at org.apache.hadoop.fs.s3a.ITestS3GuardOutOfBandOperations.expectExceptionWhenReadingOpenFileAPI(ITestS3GuardOutOfBandOperations.java:902) at org.apache.hadoop.fs.s3a.ITestS3GuardOutOfBandOperations.outOfBandDeletes(ITestS3GuardOutOfBandOperations.java:597) at org.apache.hadoop.fs.s3a.ITestS3GuardOutOfBandOperations.testOutOfBandDeletes(ITestS3GuardOutOfBandOperations.java:267) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) Caused by: java.io.FileNotFoundException: No such file or directory: s3a://hwdev-steve-ireland-new/fork-0007/test/OutOfBandDelete-977f5bc7-fb7e-498b-b4ab-0b7359ecc451 at org.apache.hadoop.fs.s3a.S3AFileSystem.s3GetFileStatus(S3AFileSystem.java:2660) at org.apache.hadoop.fs.s3a.S3AFileSystem.innerGetFileStatus(S3AFileSystem.java:2549) at org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus(S3AFileSystem.java:2450) at org.apache.hadoop.fs.s3a.S3AFileSystem.open(S3AFileSystem.java:899) at org.apache.hadoop.fs.s3a.S3AFileSystem.lambda$null$19(S3AFileSystem.java:3988) at org.apache.hadoop.util.LambdaUtils.eval(LambdaUtils.java:52) at org.apache.hadoop.fs.s3a.S3AFileSystem.lambda$openFileWithOptions$20(S3AFileSystem.java:3987) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ... 1 more [ERROR] testListingDelete[1](org.apache.hadoop.fs.s3a.ITestS3GuardOutOfBandOperations) Time elapsed: 8.426 s <<< ERROR! java.util.concurrent.ExecutionException: java.io.FileNotFoundException: No such file or directory: s3a://hwdev-steve-ireland-new/fork-0007/test/dir-63c3a32a-7b0b-489a-b629-4454e3534776/file-1-63c3a32a-7b0b-489a-b629-4454e3534776 at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357) at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1895) at org.apache.hadoop.fs.s3a.ITestS3GuardOutOfBandOperations.expectExceptionWhenReadingOpenFileAPI(ITestS3GuardOutOfBandOperations.java:902) at org.apache.hadoop.fs.s3a.ITestS3GuardOutOfBandOperations.deleteFileInListing(ITestS3GuardOutOfBandOperations.java:870) at org.apache.hadoop.fs.s3a.ITestS3GuardOutOfBandOperations.testListingDelete(ITestS3GuardOutOfBandOperations.java:282) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:748) Caused by: java.io.FileNotFoundException: No such file or directory: s3a://hwdev-steve-ireland-new/fork-0007/test/dir-63c3a32a-7b0b-489a-b629-4454e3534776/file-1-63c3a32a-7b0b-489a-b629-4454e3534776 at org.apache.hadoop.fs.s3a.S3AFileSystem.s3GetFileStatus(S3AFileSystem.java:2660) at org.apache.hadoop.fs.s3a.S3AFileSystem.innerGetFileStatus(S3AFileSystem.java:2549) at org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus(S3AFileSystem.java:2450) at org.apache.hadoop.fs.s3a.S3AFileSystem.open(S3AFileSystem.java:899) at org.apache.hadoop.fs.s3a.S3AFileSystem.lambda$null$19(S3AFileSystem.java:3988) at org.apache.hadoop.util.LambdaUtils.eval(LambdaUtils.java:52) at org.apache.hadoop.fs.s3a.S3AFileSystem.lambda$openFileWithOptions$20(S3AFileSystem.java:3987) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ... 1 more ```
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
