[
https://issues.apache.org/jira/browse/HADOOP-12666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15159956#comment-15159956
]
Sean Mackrory commented on HADOOP-12666:
----------------------------------------
+1 to making the classes in hadoop-azure-datalake all be part of the
org.apache.hadoop.fs.adl package. It's hard when reading this code to know if a
given class is part of WebHDFS or ADL because so many ADL-specific classes are
in org.apache.hadoop.hdfs.web. I don't see any reason for them to be in
separate packages.
Also, to clarify my earlier comment, currently properties like
"dfs.webhdfs.oauth2.access.token.provider" are used by both WebHDFS and ADL.
This makes it impossible to have WebHDFS and ADL configured for the same
client, so use cases like distcp'ing from one file system to another suddenly
become unreasonable to support. We should have an overridable prefix in WebHDFS
for these properties so ADL can be configured with
"dfs.adl.oauth2.access.token.provider", etc. instead.
> Support Microsoft Azure Data Lake - as a file system in Hadoop
> --------------------------------------------------------------
>
> Key: HADOOP-12666
> URL: https://issues.apache.org/jira/browse/HADOOP-12666
> Project: Hadoop Common
> Issue Type: New Feature
> Components: fs, fs/azure, tools
> Reporter: Vishwajeet Dusane
> Assignee: Vishwajeet Dusane
> Attachments: HADOOP-12666-002.patch, HADOOP-12666-003.patch,
> HADOOP-12666-004.patch, HADOOP-12666-005.patch, HADOOP-12666-006.patch,
> HADOOP-12666-1.patch
>
> Original Estimate: 336h
> Time Spent: 336h
> Remaining Estimate: 0h
>
> h2. Description
> This JIRA describes a new file system implementation for accessing Microsoft
> Azure Data Lake Store (ADL) from within Hadoop. This would enable existing
> Hadoop applications such has MR, HIVE, Hbase etc.., to use ADL store as
> input or output.
>
> ADL is ultra-high capacity, Optimized for massive throughput with rich
> management and security features. More details available at
> https://azure.microsoft.com/en-us/services/data-lake-store/
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
