[
https://issues.apache.org/jira/browse/HADOOP-14333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15977691#comment-15977691
]
Allen Wittenauer commented on HADOOP-14333:
-------------------------------------------
bq. But I think Transparent encryption is only supported by HDFS Filesystem
(DistributedFileSystem). Thats why it's not a part of FileSystem api.
This argument never ever works out in our favor. Just because Hadoop code
doesn't implement feature X for file system Y, doesn't mean file system Y
doesn't actually have feature X. Case in point: quotas. The only public APIs
are in DistributedFileSystem because people (wrongly) thought that
directory-based quotas are unique to Hadoop. As a result, we now have to
publish DFS JavaDocs publicly and it still leaves the gap for other file
systems that also implement this feature.
This really needs to get fixed before it's too late.
bq. The hive code that is broken is listed in the description.
That doesn't answer my question. This exception was added in unreleased
versions of Hadoop. So I'm not sure how this blocks Hive given they can push
out a new release before or immediately after these versions of Hadoop get out.
> New exception thrown by (private) DFSClient API isHDFSEncryptionEnabled broke
> hacky hive code
> ----------------------------------------------------------------------------------------------
>
> Key: HADOOP-14333
> URL: https://issues.apache.org/jira/browse/HADOOP-14333
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 2.8.1, 3.0.0-alpha3
> Reporter: Yongjun Zhang
> Assignee: Yongjun Zhang
>
> Though Hive should be fixed not to access DFSClient which is private to
> HADOOP, removing the throws added by HADOOP-14104 is a quicker solution to
> unblock hive.
> Hive code
> {code}
> private boolean isEncryptionEnabled(DFSClient client, Configuration conf) {
> try {
> DFSClient.class.getMethod("isHDFSEncryptionEnabled");
> } catch (NoSuchMethodException e) {
> // the method is available since Hadoop-2.7.1
> // if we run with an older Hadoop, check this ourselves
> return !conf.getTrimmed(DFSConfigKeys.DFS_ENCRYPTION_KEY_PROVIDER_URI,
> "").isEmpty();
> }
> return client.isHDFSEncryptionEnabled();
> }
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
