chenwyi2 opened a new issue, #6066:
URL: https://github.com/apache/iceberg/issues/6066

   ### Apache Iceberg version
   
   0.14.1 (latest release)
   
   ### Query engine
   
   Flink
   
   ### Please describe the bug 🐞
   
   We have a flink job that write upsert stream into a partitioned icebergV2 
table . When that job get failed, we restart it from the latest checkPoint. But 
we got that exception: Files does not exists.FileNotFoundException: File does 
not exist: 
/rbf/warehouse/cupid_bi.db/ads_qixiao_olap_1min/metadata/c918a379b3cc15d7a8193cf27eb8b473-00000-1-38851-10287.avro
   and i saw task.log
   2022-10-21 16:57:19,188 INFO 
org.apache.iceberg.flink.sink.IcebergFilesCommitter [] - Committing append with 
2 data files and 0 delete files to table icebergCatalog.xxx
   2022-10-21 16:57:19,573 INFO org.apache.iceberg.BaseMetastoreTableOperations 
[] - Successfully committed to table icebergCatalog.xx
   2022-10-21 16:57:19,573 INFO org.apache.iceberg.SnapshotProducer [] - 
Committed snapshot 7536746147835307981 (MergeAppend)
   2022-10-21 16:57:19,594 INFO org.apache.iceberg.BaseMetastoreTableOperations 
[] - Refreshing table metadata from new version: 
qbfs://online01/warehouse/xx/metadata/99171-45858db6-5917-4397-afcc-76c10ea80305.metadata.json
   2022-10-21 16:57:19,750 INFO 
org.apache.iceberg.flink.sink.IcebergFilesCommitter [] - Committed in 562 ms
   without  flushing snapshot state to state backend
   the reason is metadata checkpoint information is diffrent from 
snapshotstate? since the jobfailed without flush snapshot state to state backend


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org

Reply via email to