[
https://issues.apache.org/jira/browse/HADOOP-13037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vishwajeet Dusane updated HADOOP-13037:
---------------------------------------
Attachment: HADOOP-13037-002.patch
Patch compilation is failing to resolve SDK dependency with error
{code}
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-remote-resources-plugin:1.5:process (default) on
project hadoop-tools-dist: Failed to resolve dependencies for one or more
projects in the reactor. Reason: No versions are present in the repository for
the artifact with a range [2.0,)
[ERROR] com.microsoft.azure:azure-data-lake-store-sdk:jar:null
[ERROR]
[ERROR] from the specified remote repositories:
[ERROR] apache.snapshots.https
(https://repository.apache.org/content/repositories/snapshots, releases=true,
snapshots=true),
[ERROR] repository.jboss.org
(http://repository.jboss.org/nexus/content/groups/public/, releases=true,
snapshots=false),
[ERROR] central (http://repo.maven.apache.org/maven2, releases=true,
snapshots=false),
[ERROR] snapshots-repo
(https://oss.sonatype.org/content/repositories/snapshots, releases=false,
snapshots=true)
[ERROR] Path to dependency:
[ERROR] 1) org.apache.hadoop:hadoop-tools-dist:jar:3.0.0-alpha2-SNAPSHOT
[ERROR] 2) org.apache.hadoop:hadoop-azure-datalake:jar:3.0.0-alpha2-SNAPSHOT
[ERROR] -> [Help 1]
[ERROR]
{code}
However with test-patch script, Patch does pass through compilation.
Instead of passing range version, added a fixed version for SDK. Resubmitting
the patch.
> Azure Data Lake Client: Support Azure data lake as a file system in Hadoop
> --------------------------------------------------------------------------
>
> Key: HADOOP-13037
> URL: https://issues.apache.org/jira/browse/HADOOP-13037
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs, fs/azure, tools
> Reporter: Shrikant Naidu
> Assignee: Vishwajeet Dusane
> Fix For: 2.9.0
>
> Attachments: HADOOP-13037 Proposal.pdf, HADOOP-13037-001.patch,
> HADOOP-13037-002.patch
>
>
> The jira proposes an improvement over HADOOP-12666 to remove webhdfs
> dependencies from the ADL file system client and build out a standalone
> client. At a high level, this approach would extend the Hadoop file system
> class to provide an implementation for accessing Azure Data Lake. The scheme
> used for accessing the file system will continue to be
> adl://<accountname>.azuredatalake.net/path/to/file.
> The Azure Data Lake Cloud Store will continue to provide a webHDFS rest
> interface. The client will access the ADLS store using WebHDFS Rest APIs
> provided by the ADLS store.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
