Re: [I] manifest exception [iceberg]

2024-10-13 Thread via GitHub
github-actions[bot] commented on issue #8994: URL: https://github.com/apache/iceberg/issues/8994#issuecomment-2409443156 This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale' -- This is an automated message from the Apache Gi

Re: [I] manifest exception [iceberg]

2024-10-13 Thread via GitHub
github-actions[bot] closed issue #8994: manifest exception URL: https://github.com/apache/iceberg/issues/8994 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-

Re: [I] manifest exception [iceberg]

2024-09-28 Thread via GitHub
github-actions[bot] commented on issue #8994: URL: https://github.com/apache/iceberg/issues/8994#issuecomment-2381033384 This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs.

Re: [I] manifest exception [iceberg]

2023-11-12 Thread via GitHub
innocent123 commented on issue #8994: URL: https://github.com/apache/iceberg/issues/8994#issuecomment-1807611823 > > Thank you very much! my historical snapshot is lost ,You can only recover by deleting files.One more question.Is there a way to quickly know that the manifest file no lon

Re: [I] manifest exception [iceberg]

2023-11-12 Thread via GitHub
wangtaohz commented on issue #8994: URL: https://github.com/apache/iceberg/issues/8994#issuecomment-1807605797 > Thank you very much! my historical snapshot is lost ,You can only recover by deleting files.One more question.Is there a way to quickly know that the manifest file no longer exis

Re: [I] manifest exception [iceberg]

2023-11-12 Thread via GitHub
innocent123 commented on issue #8994: URL: https://github.com/apache/iceberg/issues/8994#issuecomment-1807569922 > > The problem is that the path in the manifest file does not exist in the hdfs. However, I cannot modify the manifest file directly. Is there an api that can modify the

Re: [I] manifest exception [iceberg]

2023-11-12 Thread via GitHub
wangtaohz commented on issue #8994: URL: https://github.com/apache/iceberg/issues/8994#issuecomment-1807532630 > The problem is that the path in the manifest file does not exist in the hdfs. However, I cannot modify the manifest file directly. Is there an api that can modify the manifest fi

Re: [I] manifest exception [iceberg]

2023-11-12 Thread via GitHub
innocent123 commented on issue #8994: URL: https://github.com/apache/iceberg/issues/8994#issuecomment-1807367945 The problem is that the path in the manifest file does not exist in the hdfs. However, I cannot modify the manifest file directly. Is there an api that can modify the manifest fi

Re: [I] manifest exception [iceberg]

2023-11-12 Thread via GitHub
innocent123 commented on issue #8994: URL: https://github.com/apache/iceberg/issues/8994#issuecomment-1807366431 > I guess the missing data file was caused by `deleteOrphanFiles set olderThan(System.currentTimeMillis())`, which mistakenly treated the uncommitted data files as orphan files a

Re: [I] manifest exception [iceberg]

2023-11-09 Thread via GitHub
wangtaohz commented on issue #8994: URL: https://github.com/apache/iceberg/issues/8994#issuecomment-1805001260 I guess the missing data file was caused by `deleteOrphanFiles set olderThan(System.currentTimeMillis())`, which mistakenly treated the uncommitted data files as orphan files and d

Re: [I] manifest exception [iceberg]

2023-11-08 Thread via GitHub
innocent123 commented on issue #8994: URL: https://github.com/apache/iceberg/issues/8994#issuecomment-1803192419 iceberg version1.0.0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [I] manifest exception [iceberg]

2023-11-08 Thread via GitHub
innocent123 commented on issue #8994: URL: https://github.com/apache/iceberg/issues/8994#issuecomment-1803192032 spark version 3.0.2 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

Re: [I] manifest exception [iceberg]

2023-11-08 Thread via GitHub
innocent123 commented on issue #8994: URL: https://github.com/apache/iceberg/issues/8994#issuecomment-1803189818 > > @innocent123: I do not really understand your question, but I think your problem might be similar to #5846. > > when i use spark api rewriteDataFiles is reported "org.

Re: [I] manifest exception [iceberg]

2023-11-08 Thread via GitHub
innocent123 commented on issue #8994: URL: https://github.com/apache/iceberg/issues/8994#issuecomment-1803186989 > @innocent123: I do not really understand your question, but I think your problem might be similar to #5846. when i use spark api rewriteDataFiles is reported "org.apache

Re: [I] manifest exception [iceberg]

2023-11-07 Thread via GitHub
pvary commented on issue #8994: URL: https://github.com/apache/iceberg/issues/8994#issuecomment-1798296469 @innocent123: I do not really understand your question, but I think your problem might be similar to #5846. -- This is an automated message from the Apache Git Service. To respon

[I] manifest exception [iceberg]

2023-11-07 Thread via GitHub
innocent123 opened a new issue, #8994: URL: https://github.com/apache/iceberg/issues/8994 ### Query engine When I write tables with flink, I periodically manipulate metadata with spark, rewriteDataFiles, rewriteManifests, expireSnapshots, deleteOrphanFiles are created in sequence, an