[
https://issues.apache.org/jira/browse/HADOOP-13037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Douglas updated HADOOP-13037:
-----------------------------------
Attachment: HADOOP-13037.005.patch
Thanks, [~vishwajeet.dusane]. I need to test it using some valid credentials,
but this looks good, overall. I made a few minor changes as I was going through
the patch, posted as v005. Please review.
* Smartquote in {{index.md}} replaced with quote
* Changed some uses of {{Configuration#get/setClass}} to improve type safety
* Removed {{\@VisibleForTesting}} annotations from {{AdlFileSystem}} fields
* Removed deleted config params from {{TestConcurrentDataReadOperations}}
* Collapsed static imports from {{AdlConfKeys}}
* Removed a call to {{incrementReadOps}} from
{{AdlFileSystem#getFileBlockLocations}}, as it's incremented in
{{getFileStatus}}
* Changed some unit tests that succeed for thrown exceptions to use the
{{\@Test(expected=ExceptionType.class)}} syntax
* Flipped {{assertEquals(expected, actual)}} where these were inverted
BTW- {{adls.xml}} adds the following:
{noformat}
+ <property>
+ <name>fs.contract.is-blobstore</name>
+ <value>true</value>
+ </property>
{noformat}
I'm not familiar with this parameter. What is it controlling?
> Azure Data Lake Client: Support Azure data lake as a file system in Hadoop
> --------------------------------------------------------------------------
>
> Key: HADOOP-13037
> URL: https://issues.apache.org/jira/browse/HADOOP-13037
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs, fs/azure, tools
> Reporter: Shrikant Naidu
> Assignee: Vishwajeet Dusane
> Fix For: 2.9.0
>
> Attachments: HADOOP-13037 Proposal.pdf, HADOOP-13037-001.patch,
> HADOOP-13037-002.patch, HADOOP-13037-003.patch, HADOOP-13037-004.patch,
> HADOOP-13037.005.patch
>
>
> The jira proposes an improvement over HADOOP-12666 to remove webhdfs
> dependencies from the ADL file system client and build out a standalone
> client. At a high level, this approach would extend the Hadoop file system
> class to provide an implementation for accessing Azure Data Lake. The scheme
> used for accessing the file system will continue to be
> adl://<accountname>.azuredatalake.net/path/to/file.
> The Azure Data Lake Cloud Store will continue to provide a webHDFS rest
> interface. The client will access the ADLS store using WebHDFS Rest APIs
> provided by the ADLS store.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
