[
https://issues.apache.org/jira/browse/HADOOP-18528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17634257#comment-17634257
]
ASF GitHub Bot commented on HADOOP-18528:
-----------------------------------------
mehakmeet commented on PR #5134:
URL: https://github.com/apache/hadoop/pull/5134#issuecomment-1315026565
Okay, ran the test suite on trunk as well. **There are no additional
errors/failures after the changes**, it's showing some errors on the base
version.
```
[ERROR]
testGetIsNamespaceEnabledWhenConfigIsTrue(org.apache.hadoop.fs.azurebfs.ITestGetNameSpaceEnabled)
Time elapsed: 3.876 s <<< FAILURE!
org.junit.ComparisonFailure: [getIsNamespaceEnabled should return the value
configured for fs.azure.test.namespace.enabled] expected:<[fals]e> but
was:<[tru]e>
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
```
Not sure why this is a failure and not just skipping the test in case the
config isn't set.
```
[ERROR] Tests run: 13, Failures: 1, Errors: 0, Skipped: 0, Time elapsed:
82.967 s <<< FAILURE! - in
org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemLease
[ERROR]
testTwoCreate(org.apache.hadoop.fs.azurebfs.ITestAzureBlobFileSystemLease)
Time elapsed: 6.501 s <<< FAILURE!
java.lang.AssertionError:
Expected to find 'There is currently a lease on the resource and no lease
ID was specified in the request' but got unexpected exception:
org.apache.hadoop.fs.PathIOException:
`abfs://abfs-testcontainer-f5fe9b62-0253-4a90-af0a-d43bd5970...@mmtusw.dfs.core.windows.net/fork-0001/test/testTwoCreatedec41fc7870b/testfile':
Input/output error: Parallel access to the create path detected. Failing
request to honor single writer semantics
at
org.apache.hadoop.fs.azurebfs.AzureBlobFileSystem.checkException(AzureBlobFileSystem.java:1500)
at
org.apache.hadoop.fs.azurebfs.AzureBlobFileSystem.create(AzureBlobFileSystem.java:331)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:1231)
...
Caused by: Parallel access to the create path detected. Failing request to
honor single writer semantics
at
org.apache.hadoop.fs.azurebfs.AzureBlobFileSystemStore.conditionalCreateOverwriteFile(AzureBlobFileSystemStore.java:652)
at
org.apache.hadoop.fs.azurebfs.AzureBlobFileSystemStore.createFile(AzureBlobFileSystemStore.java:563)
```
Seeing it fail as a stand-alone test as well.
```
[WARNING] Tests run: 48, Failures: 0, Errors: 0, Skipped: 24, Time elapsed:
396.823 s - in org.apache.hadoop.fs.azurebfs.ITestSmallWriteOptimization
[ERROR] Tests run: 10, Failures: 1, Errors: 0, Skipped: 0, Time elapsed:
725.369 s <<< FAILURE! - in
org.apache.hadoop.fs.azurebfs.ITestAbfsReadWriteAndSeek
[ERROR]
testReadAndWriteWithDifferentBufferSizesAndSeek[Size=104,857,600-readahead=true](org.apache.hadoop.fs.azurebfs.ITestAbfsReadWriteAndSeek)
Time elapsed: 670.478 s <<< FAILURE!
org.junit.ComparisonFailure: [Retry was required due to issue on server
side] expected:<[0]> but was:<[1]>
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
```
Intermittent failure, saw this in trunk once.
Also had a timeout error in ITestAbfsTerasort.
> ABFS: Disable readAhead/prefetching by default
> ----------------------------------------------
>
> Key: HADOOP-18528
> URL: https://issues.apache.org/jira/browse/HADOOP-18528
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs/azure
> Affects Versions: 3.3.4
> Reporter: Mehakmeet Singh
> Assignee: Mehakmeet Singh
> Priority: Major
> Labels: pull-request-available
>
> After the addition of HADOOP-18517, we should disable readAhead by default to
> mitigate inconsistent read results caused by ABFS prefetching, HADOOP-18521.
> As an urgent fix: Disable readAhead/prefetch, tracked for 3.3.5.
> Long-term fix: HADOOP-18521, tracked for 3.3.6.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
