Re: [I] Transient AWS Connection Issues [iceberg]

2025-01-15 Thread via GitHub
steveloughran commented on issue #11412: URL: https://github.com/apache/iceberg/issues/11412#issuecomment-2592960320 Even if you share a single client, the v2 SDK IAM credential provider on EC2 (not k8s) is unable to recover from 503 errors during is refresh, as it tries to refresh the cred

Re: [I] Transient AWS Connection Issues [iceberg]

2024-10-28 Thread via GitHub
arifazmidd commented on issue #11412: URL: https://github.com/apache/iceberg/issues/11412#issuecomment-2442030788 Full error message: ``` : org.apache.spark.SparkException: Job aborted due to stage failure: Task 236 in stage 1.0 failed 4 times, most recent failure: Lost task 236.3 in s

[I] Transient AWS Connection Issues [iceberg]

2024-10-28 Thread via GitHub
arifazmidd opened a new issue, #11412: URL: https://github.com/apache/iceberg/issues/11412 ### Apache Iceberg version 1.6.1 (latest release) ### Query engine Spark ### Please describe the bug 🐞 There seems to be some transient AWS connection issues with runn

Re: [I] Transient AWS Connection Issues [iceberg]

2024-10-28 Thread via GitHub
arifazmidd commented on issue #11412: URL: https://github.com/apache/iceberg/issues/11412#issuecomment-2442029838 Spark config: ``` spark.sql.catalog.iceberg.glue.id: "" spark.sql.catalog.iceberg.catalog-impl: "org.apache.iceberg.aws.glue.GlueCatalog" spark.sql.extensions: "org.