Re: [I] MinIO + Spark + hive metadata + iceberg format [iceberg]

2024-11-07 Thread via GitHub
xhuyvn commented on issue #10222: URL: https://github.com/apache/iceberg/issues/10222#issuecomment-2462560292 > Hi, have you found the solution yet? i have the same problem when using hive 4.0 with minio: > > pyspark.errors.exceptions.captured.AnalysisException: org.apache.hadoop.hiv

Re: [I] MinIO + Spark + hive metadata + iceberg format [iceberg]

2024-11-06 Thread via GitHub
mustafaaykon commented on issue #10222: URL: https://github.com/apache/iceberg/issues/10222#issuecomment-2461433487 Hi @rychu151 , I saw you passed you passed 'fs.s3a.endpoint' as localhost. I think, It shouldn't be localhost because hive is working on different container and MinIO is wo

Re: [I] MinIO + Spark + hive metadata + iceberg format [iceberg]

2024-05-17 Thread via GitHub
rychu151 closed issue #10222: MinIO + Spark + hive metadata + iceberg format URL: https://github.com/apache/iceberg/issues/10222 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [I] MinIO + Spark + hive metadata + iceberg format [iceberg]

2024-05-17 Thread via GitHub
rychu151 commented on issue #10222: URL: https://github.com/apache/iceberg/issues/10222#issuecomment-2117315115 I resigned from using hive-metastore. Nessie has no compatibility issues -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [I] MinIO + Spark + hive metadata + iceberg format [iceberg]

2024-05-12 Thread via GitHub
vinh22032000 commented on issue #10222: URL: https://github.com/apache/iceberg/issues/10222#issuecomment-2106286472 Hi, have you found the solution yet? i have the same problem when using hive 4.0 with minio: pyspark.errors.exceptions.captured.AnalysisException: org.apache.hadoop.hiv

[I] MinIO + Spark + hive metadata + iceberg format [iceberg]

2024-04-25 Thread via GitHub
rychu151 opened a new issue, #10222: URL: https://github.com/apache/iceberg/issues/10222 ### Query engine Spark ### Question Im trying to setup local develop env for my testing purposes using docker **Target is to save dataframe in a Iceberg format and Hive-metadat