[
https://issues.apache.org/jira/browse/HADOOP-18728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17718933#comment-17718933
]
Steve Loughran commented on HADOOP-18728:
-----------------------------------------
Starting: GetFileStatus abfs://[email protected]/
Duration of GetFileStatus
abfs://[email protected]/: 0:00:268
org.apache.hadoop.fs.FileAlreadyExistsException: Operation failed: "This
endpoint does not support BlobStorageEvents or SoftDelete. Please disable these
account features if you would like to use this endpoint.", 409, HEAD,
https://somewhere.dfs.core.windows.net/stevel-testing2/?upn=false&action=getAccessControl&timeout=90
at
org.apache.hadoop.fs.azurebfs.AzureBlobFileSystem.checkException(AzureBlobFileSystem.java:1484)
at
org.apache.hadoop.fs.azurebfs.AzureBlobFileSystem.getFileStatus(AzureBlobFileSystem.java:714)
at
org.apache.hadoop.fs.azurebfs.AzureBlobFileSystem.getFileStatus(AzureBlobFileSystem.java:702)
at
org.apache.hadoop.fs.store.diag.StoreDiag.executeFileSystemOperations(StoreDiag.java:775)
at org.apache.hadoop.fs.store.diag.StoreDiag.run(StoreDiag.java:238)
at org.apache.hadoop.fs.store.diag.StoreDiag.run(StoreDiag.java:175)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:82)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:97)
at org.apache.hadoop.fs.store.diag.StoreDiag.exec(StoreDiag.java:1158)
at org.apache.hadoop.fs.store.diag.StoreDiag.main(StoreDiag.java:1167)
at storediag.main(storediag.java:25)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.util.RunJar.run(RunJar.java:328)
at org.apache.hadoop.util.RunJar.main(RunJar.java:241)
Caused by: Operation failed: "This endpoint does not support BlobStorageEvents
or SoftDelete. Please disable these account features if you would like to use
this endpoint.", 409, HEAD,
https://somewhere.dfs.core.windows.net/stevel-testing2/?upn=false&action=getAccessControl&timeout=90
at
org.apache.hadoop.fs.azurebfs.services.AbfsRestOperation.completeExecute(AbfsRestOperation.java:234)
at
org.apache.hadoop.fs.azurebfs.services.AbfsRestOperation.lambda$execute$0(AbfsRestOperation.java:194)
at
org.apache.hadoop.fs.statistics.impl.IOStatisticsBinding.measureDurationOfInvocation(IOStatisticsBinding.java:494)
at
org.apache.hadoop.fs.statistics.impl.IOStatisticsBinding.trackDurationOfInvocation(IOStatisticsBinding.java:465)
at
org.apache.hadoop.fs.azurebfs.services.AbfsRestOperation.execute(AbfsRestOperation.java:192)
at
org.apache.hadoop.fs.azurebfs.services.AbfsClient.getAclStatus(AbfsClient.java:1052)
at
org.apache.hadoop.fs.azurebfs.services.AbfsClient.getAclStatus(AbfsClient.java:1033)
at
org.apache.hadoop.fs.azurebfs.AzureBlobFileSystemStore.getFileStatus(AzureBlobFileSystemStore.java:991)
at
org.apache.hadoop.fs.azurebfs.AzureBlobFileSystem.getFileStatus(AzureBlobFileSystem.java:712)
... 15 more
2023-05-03 14:14:09,315 [main] INFO uti
> ABFS handles nonexistent/non-auth accounts badly
> ------------------------------------------------
>
> Key: HADOOP-18728
> URL: https://issues.apache.org/jira/browse/HADOOP-18728
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs/azure
> Affects Versions: 3.3.5
> Reporter: Steve Loughran
> Priority: Major
>
> Testing storediag with a nonexistent account/bucket raises interesting
> failures modes
> # DNS failures are retried, rather than fail fast
> # a container which exists but you can't access fails with the wrong exception
> {code}
> org.apache.hadoop.fs.FileAlreadyExistsException: Operation failed: "This
> endpoint does not support BlobStorageEvents or SoftDelete. Please disable
> these account features if you would like to use this endpoint.", 409, HEAD,
> https://somewhere.dfs.core.windows
> {code}
> Proposed
> # failfast on host not found, escalate to an account not found
> # recognise and translate that does not support BlobStorageEvents
> side issue: is that failure leaking secrets about another a/c? or is it
> always raised if not authed
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
