[
https://issues.apache.org/jira/browse/HADOOP-13372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15376646#comment-15376646
]
Steve Loughran commented on HADOOP-13372:
-----------------------------------------
Patch seems reasonable, what s3 and s3a do (not azure, interestingly)
Because Jenkins doesn't test any of the object stores, we have to push a bit
more work onto everyone submitting patches for them.
Can you follow the instructions here and tell is which swift infrastructure you
tested against? If its local, just the OS and openstack versions. We have the
rule to make sure everyone does a full test run themselves
https://wiki.apache.org/hadoop/HowToContribute#Submitting_patches_against_object_stores_such_as_Amazon_S3.2C_OpenStack_Swift_and_Microsoft_Azure
> MR jobs can not access Swift filesystem if Kerberos is enabled
> --------------------------------------------------------------
>
> Key: HADOOP-13372
> URL: https://issues.apache.org/jira/browse/HADOOP-13372
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs, fs/swift, security
> Reporter: ramtin
> Attachments: HADOOP-13372.001.patch
>
>
> java.lang.IllegalArgumentException: java.net.UnknownHostException:
> at
> org.apache.hadoop.security.SecurityUtil.buildTokenService(SecurityUtil.java:378)
> at
> org.apache.hadoop.security.SecurityUtil.buildDTServiceName(SecurityUtil.java:262)
> at
> org.apache.hadoop.fs.FileSystem.getCanonicalServiceName(FileSystem.java:303)
> at
> org.apache.hadoop.fs.FileSystem.collectDelegationTokens(FileSystem.java:524)
> at
> org.apache.hadoop.fs.FileSystem.addDelegationTokens(FileSystem.java:508)
> at
> org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:121)
> at
> org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:100)
> at
> org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodes(TokenCache.java:80)
> at
> org.apache.hadoop.tools.mapred.CopyOutputFormat.checkOutputSpecs(CopyOutputFormat.java:121)
> at
> org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:266)
> at
> org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:139)
> at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290)
> at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287)
> at org.apache.hadoop.tools.DistCp.createAndSubmitJob(DistCp.java:183)
> at org.apache.hadoop.tools.DistCp.execute(DistCp.java:153)
> at org.apache.hadoop.tools.DistCp.run(DistCp.java:126)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at org.apache.hadoop.tools.DistCp.main(DistCp.java:430)
> Caused by: java.net.UnknownHostException:
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
