Re: [I] Spark write abort result in table miss metadata location file [iceberg]

2024-10-10 Thread via GitHub
github-actions[bot] commented on issue #8927: URL: https://github.com/apache/iceberg/issues/8927#issuecomment-2406263940 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Gi

Re: [I] Spark write abort result in table miss metadata location file [iceberg]

2024-10-10 Thread via GitHub
github-actions[bot] closed issue #8927: Spark write abort result in table miss metadata location file URL: https://github.com/apache/iceberg/issues/8927 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [I] Spark write abort result in table miss metadata location file [iceberg]

2024-09-25 Thread via GitHub
github-actions[bot] commented on issue #8927: URL: https://github.com/apache/iceberg/issues/8927#issuecomment-2375486939 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [I] Spark write abort result in table miss metadata location file [iceberg]

2023-10-30 Thread via GitHub
dyno commented on issue #8927: URL: https://github.com/apache/iceberg/issues/8927#issuecomment-1785479202 thanks @ConeyLiu ! will try 1.3.1. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

Re: [I] Spark write abort result in table miss metadata location file [iceberg]

2023-10-29 Thread via GitHub
ConeyLiu commented on issue #8927: URL: https://github.com/apache/iceberg/issues/8927#issuecomment-1784369261 Please try to latest version. I think this problem has been fixed by https://github.com/apache/iceberg/pull/7931 -- This is an automated message from the Apache Git Service. To re

Re: [I] Spark write abort result in table miss metadata location file [iceberg]

2023-10-27 Thread via GitHub
dyno commented on issue #8927: URL: https://github.com/apache/iceberg/issues/8927#issuecomment-1783724655 or the main problem is iceberg should not update metadata location in hive metastore before the write is actually completed. and the symptom is write is failed but the metadata location

Re: [I] Spark write abort result in table miss metadata location file [iceberg]

2023-10-27 Thread via GitHub
dyno commented on issue #8927: URL: https://github.com/apache/iceberg/issues/8927#issuecomment-1783720979 probably the error message just means the data file and maniefst files but not the metadata location file? i am sure the medata location file was gone and from s3 access log the deletio

Re: [I] Spark write abort result in table miss metadata location file [iceberg]

2023-10-26 Thread via GitHub
nk1506 commented on issue #8927: URL: https://github.com/apache/iceberg/issues/8927#issuecomment-1782354754 @dyno , as per log message > W1024 22:07:51.303 pool-38-thread-273 o.a.i.s.s.SparkWrite:226] Skipping cleanup of written files It means files should not be deleted.

[I] Spark write abort result in table miss metadata location file [iceberg]

2023-10-26 Thread via GitHub
dyno opened a new issue, #8927: URL: https://github.com/apache/iceberg/issues/8927 https://github.com/apache/iceberg/blob/333227fbd13821365cec1bdbfcb9314a239bea0f/hive-metastore/src/main/java/org/apache/iceberg/hive/HiveTableOperations.java#L244-L255 recently we encounter a few cases