[
https://issues.apache.org/jira/browse/HADOOP-12666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vishwajeet Dusane updated HADOOP-12666:
---------------------------------------
Attachment: HADOOP-12666-005.patch
Incorporated review comment from [~chris.douglas]
1. FileStatusCacheManger.java - Remove dependency from Timer to manage cache
expiry time. Use LinkedHashMap with object insert time and expiry in seconds.
2. FileStatusCacheManger.java - Cache to hold upto 5000 FileStatus instances
3. ADLFeatureConfig.java - Removed global configuration to Webhdfds specific
instance
4. Added test cases to verify caching scenario
5. PrivateAzureDataLakeFileSystem.java replaced "swebhdfs" scheme with "adl" to
avoid wrong class being loaded for "swebhdfs" config
6. Removed custom checkstyle.xml reference to default checkstyle.xml
configuration
> Support Microsoft Azure Data Lake - as a file system in Hadoop
> --------------------------------------------------------------
>
> Key: HADOOP-12666
> URL: https://issues.apache.org/jira/browse/HADOOP-12666
> Project: Hadoop Common
> Issue Type: New Feature
> Components: fs, fs/azure, tools
> Reporter: Vishwajeet Dusane
> Assignee: Vishwajeet Dusane
> Attachments: HADOOP-12666-002.patch, HADOOP-12666-003.patch,
> HADOOP-12666-004.patch, HADOOP-12666-005.patch, HADOOP-12666-1.patch
>
> Original Estimate: 336h
> Time Spent: 336h
> Remaining Estimate: 0h
>
> h2. Description
> This JIRA describes a new file system implementation for accessing Microsoft
> Azure Data Lake Store (ADL) from within Hadoop. This would enable existing
> Hadoop applications such has MR, HIVE, Hbase etc.., to use ADL store as
> input or output.
>
> ADL is ultra-high capacity, Optimized for massive throughput with rich
> management and security features. More details available at
> https://azure.microsoft.com/en-us/services/data-lake-store/
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
