AwasthiSomesh commented on issue #11145:
URL: https://github.com/apache/iceberg/issues/11145#issuecomment-2361405565
@pvary we set set hive.execution.engine=mr? for insert else insert was not
working with tez engine
but with mr we are not able to read any single table with hive 4.0.4. alph2
with tez we are facing below error wj=hile inserting records
Error:
.6.jar:?]
at
org.apache.hadoop.fs.s3a.S3AFileSystem.lambda$exists$34(S3AFileSystem.java:4636)
~[hadoop-aws-3.3.6.jar:?]
at
org.apache.hadoop.fs.statistics.impl.IOStatisticsBinding.invokeTrackingDuration(IOStatisticsBinding.java:547)
~[hadoop-common-3.3.6.jar:?]
at
org.apache.hadoop.fs.statistics.impl.IOStatisticsBinding.lambda$trackDurationOfOperation$5(IOStatisticsBinding.java:528)
~[hadoop-common-3.3.6.jar:?]
at
org.apache.hadoop.fs.statistics.impl.IOStatisticsBinding.trackDuration(IOStatisticsBinding.java:449)
~[hadoop-common-3.3.6.jar:?]
at
org.apache.hadoop.fs.s3a.S3AFileSystem.trackDurationAndSpan(S3AFileSystem.java:2480)
~[hadoop-aws-3.3.6.jar:?]
at
org.apache.hadoop.fs.s3a.S3AFileSystem.trackDurationAndSpan(S3AFileSystem.java:2499)
~[hadoop-aws-3.3.6.jar:?]
at
org.apache.hadoop.fs.s3a.S3AFileSystem.exists(S3AFileSystem.java:4634)
~[hadoop-aws-3.3.6.jar:?]
at
org.apache.tez.common.TezCommonUtils.getTezBaseStagingPath(TezCommonUtils.java:91)
~[tez-api-0.10.3.jar:0.10.3]
at
org.apache.tez.common.TezCommonUtils.getTezSystemStagingPath(TezCommonUtils.java:149)
~[tez-api-0.10.3.jar:0.10.3]
at
org.apache.tez.dag.app.DAGAppMaster.serviceInit(DAGAppMaster.java:492)
~[tez-dag-0.10.3.jar:0.10.3]
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
~[hadoop-common-3.3.6.jar:?]
at org.apache.tez.dag.app.DAGAppMaster$9.run(DAGAppMaster.java:2644)
~[tez-dag-0.10.3.jar:0.10.3]
at java.security.AccessController.doPrivileged(Native Method)
~[?:1.8.0_342]
at javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_342]
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1899)
~[hadoop-common-3.3.6.jar:?]
at
org.apache.tez.dag.app.DAGAppMaster.initAndStartAppMaster(DAGAppMaster.java:2641)
~[tez-dag-0.10.3.jar:0.10.3]
at org.apache.tez.client.LocalClient$1.run(LocalClient.java:361)
~[tez-dag-0.10.3.jar:0.10.3]
... 1 more
ERROR : FAILED: Execution Error, return code 1 from
org.apache.hadoop.hive.ql.exec.tez.TezTask. java.io.IOException:
org.apache.tez.dag.api.TezUncheckedException:
java.nio.file.AccessDeniedException:
s3a://com.anush/opt/hive/scratch_dir/hive/_tez_session_dir/0c1896fa-2b9d-4461-9ab4-ced0fd46ef48:
org.apache.hadoop.fs.s3a.auth.NoAuthWithAWSException: No AWS Credentials
provided by TemporaryAWSCredentialsProvider SimpleAWSCredentialsProvider
EnvironmentVariableCredentialsProvider IAMInstanceCredentialsProvider :
com.amazonaws.SdkClientException: Unable to load AWS credentials from
environment variables (AWS_ACCESS_KEY_ID (or AWS_ACCESS_KEY) and AWS_SECRET_KEY
(or AWS_SECRET_ACCESS_KEY))
INFO : Completed executing
command(queryId=hive_20240919065346_a71fd349-e14c-4bfa-9fb7-0b1b396565e3); Time
taken: 44.607 seconds
Error: Error while compiling statement: FAILED: Execution Error, return code
1 from org.apache.hadoop.hive.ql.exec.tez.TezTask. java.io.IOException:
org.apache.tez.dag.api.TezUncheckedException:
java.nio.file.AccessDeniedException:
s3a://com.anush/opt/hive/scratch_dir/hive/_tez_session_dir/0c1896fa-2b9d-4461-9ab4-ced0fd46ef48:
org.apache.hadoop.fs.s3a.auth.NoAuthWithAWSException: No AWS Credentials
provided by TemporaryAWSCredentialsProvider SimpleAWSCredentialsProvider
EnvironmentVariableCredentialsProvider IAMInstanceCredentialsProvider :
com.amazonaws.SdkClientException: Unable to load AWS credentials from
environment variables (AWS_ACCESS_KEY_ID (or AWS_ACCESS_KEY) and AWS_SECRET_KEY
(or AWS_SECRET_ACCESS_KEY)) (state=08S01,code=1)
0: jdbc:hive2://localhost:10000/>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org
