ZhendongBai opened a new issue, #11575:
URL: https://github.com/apache/iceberg/issues/11575
### Apache Iceberg version
1.1.0
### Query engine
Flink
### Please describe the bug 🐞
when calling checkCommitStatus method, unexpected errors maybe occur, such
as OutOfMemoryError, during the checkCommitStatus method execution. the code
show as below:
```
commitStatus =
checkCommitStatus(
viewName,
newMetadataLocation,
metadata.properties(),
() -> checkCurrentMetadataLocation(newMetadataLocation));
```
During the execution of the
`org.apache.iceberg.hive.HiveViewOperations.checkCurrentMetadataLocation`
method's refresh operation to download and update the current table metadata,
memory consumption occurs, potentially leading to an `OutOfMemoryError`.
It is important to note that `Tasks` may not handle `Error` exceptions,
instead throwing them directly.
Finally, in the `finally` block, the cleanupMetadataAndUnlock function may
delete the table snapshot metadata file, even if it has been recently committed.
### Willingness to contribute
- [X] I can contribute a fix for this bug independently
- [X] I would be willing to contribute a fix for this bug with guidance from
the Iceberg community
- [ ] I cannot contribute a fix for this bug at this time
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org
