rahulkr25 commented on issue #6066:
URL: https://github.com/apache/iceberg/issues/6066#issuecomment-2484868647
1. Do we have any update here, whether we have planned the resolution for
this bug? @jad-grepr @stevenzwu
2. Secondly, as @congd123 mentioned, What is the best approach for recovery
here? as Once i start seeing these errors
-> the table is now inaccessible i.e., neither i am able to do any
operations through flink nor through trino
Facing issue with version Flink 1.16 and Iceberg 1.3.1, as issue reported by
@jad-grepr the issue is coming in latest version also
Attaching StackTrace
```
{"flowId":"37d1732c-20d4-49b4-99b3-67d2ca10e492","id":"6","type":"Error","time":{"sec":1731996384,"micros":358067},"title":"exception
while executing
job","level":"ERROR","attributes":{"stackTrace":"org.apache.iceberg.exceptions.NotFoundException:
Failed to open input stream for file:
s3a://<>/<>/<>.events/metadata/12454-c7fe536d-cdd8-47b4-93d7-a6b1d915ef4c.metadata.json\n\tat
org.apache.iceberg.hadoop.HadoopInputFile.newStream(HadoopInputFile.java:185)\n\tat
org.apache.iceberg.TableMetadataParser.read(TableMetadataParser.java:272)\n\tat
org.apache.iceberg.TableMetadataParser.read(TableMetadataParser.java:266)\n\tat
org.apache.iceberg.BaseMetastoreTableOperations.lambda$refreshFromMetadataLocation$0(BaseMetastoreTableOperations.java:189)\n\tat
org.apache.iceberg.BaseMetastoreTableOperations.lambda$refreshFromMetadataLocation$1(BaseMetastoreTableOperations.java:208)\n\tat
org.apache.iceberg.util.Tasks$Builder.runTaskWithRetry(Tasks.java:413)\n\tat
org.apache.iceberg.util.Tasks$Buil
der.runSingleThreaded(Tasks.java:219)\n\tat
org.apache.iceberg.util.Tasks$Builder.run(Tasks.java:203)\n\tat
org.apache.iceberg.util.Tasks$Builder.run(Tasks.java:196)\n\tat
org.apache.iceberg.BaseMetastoreTableOperations.refreshFromMetadataLocation(BaseMetastoreTableOperations.java:208)\n\tat
org.apache.iceberg.BaseMetastoreTableOperations.refreshFromMetadataLocation(BaseMetastoreTableOperations.java:185)\n\tat
org.apache.iceberg.BaseMetastoreTableOperations.refreshFromMetadataLocation(BaseMetastoreTableOperations.java:180)\n\tat
org.apache.iceberg.hive.HiveTableOperations.doRefresh(HiveTableOperations.java:178)\n\tat
org.apache.iceberg.BaseMetastoreTableOperations.refresh(BaseMetastoreTableOperations.java:97)\n\tat
org.apache.iceberg.BaseMetastoreTableOperations.current(BaseMetastoreTableOperations.java:80)\n\tat
org.apache.iceberg.BaseMetastoreCatalog.loadTable(BaseMetastoreCatalog.java:47)\n\tat
org.apache.iceberg.catalog.Catalog.tableExists(Catalog.java:281)\n\tat
in.zeta.perseus
.iceberg.operator.sink.IcebergTableLoader.createTable(IcebergTableLoader.java:107)\n\tat
in.zeta.perseus.iceberg.operator.sink.IcebergTableLoader.createIcebergTableIfNotExists(IcebergTableLoader.java:54)\n\tat
in.zeta.perseus.iceberg.operator.sink.IcebergTableLoader.getTableLoader(IcebergTableLoader.java:31)\n\tat
in.zeta.perseus.iceberg.operator.sink.IcebergSinkOperator.sinkStream(IcebergSinkOperator.java:40)\n\tat
in.zeta.perseus.core.job.JobBuilder.sinkStream(JobBuilder.java:225)\n\tat
in.zeta.perseus.core.job.JobBuilder.lambda$buildSinkOperator$2(JobBuilder.java:182)\n\tat
java.base/java.util.Optional.ifPresent(Unknown Source)\n\tat
in.zeta.perseus.core.job.JobBuilder.buildSinkOperator(JobBuilder.java:180)\n\tat
in.zeta.perseus.core.job.JobBuilder.executeJobGraphTopologically(JobBuilder.java:111)\n\tat
in.zeta.perseus.core.job.JobBuilder.buildAndExecuteJobGraph(JobBuilder.java:69)\n\tat
in.zeta.perseus.core.job.JobBuilder.buildJob(JobBuilder.java:56)\n\tat
in.zeta.perseus.core.J
obDriver.validateAndBuildJob(JobDriver.java:44)\n\tat
in.zeta.perseus.core.JobDriver.main(JobDriver.java:25)\n\tat
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
Method)\n\tat
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown
Source)\n\tat
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown
Source)\n\tat java.base/java.lang.reflect.Method.invoke(Unknown Source)\n\tat
org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355)\n\tat
org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222)\n\tat
org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:98)\n\tat
org.apache.flink.client.deployment.application.DetachedApplicationRunner.tryExecuteJobs(DetachedApplicationRunner.java:84)\n\tat
org.apache.flink.client.deployment.application.DetachedApplicationRunner.run(DetachedApplicationRunner.java:70)\n\tat
org.apache.flink.runtime.
webmonitor.handlers.JarRunHandler.lambda$handleRequest$0(JarRunHandler.java:107)\n\tat
java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(Unknown
Source)\n\tat java.base/java.lang.Thread.run(Unknown Source)\nCaused by:
java.io.FileNotFoundException: No such file or directory:
s3a://<>/<>/<>/metadata/12454-c7fe536d-cdd8-47b4-93d7-a6b1d915ef4c.metadata.json\n\tat
org.apache.hadoop.fs.s3a.S3AFileSystem.s3GetFileStatus(S3AFileSystem.java:3866)\n\tat
org.apache.hadoop.fs.s3a.S3AFileSystem.innerGetFileStatus(S3AFileSystem.java:3688)\n\tat
org.apache.hadoop.fs.s3a.S3AFileSystem.extractOrFetchSimpleFileStatus(S3AFileSystem.java:5401)\n\tat
org.apache.hadoop.fs.s3a.S3AFileSystem.open(S3AFileSystem.java:1465)\n\tat
org.apache.hadoop.fs.s3a.S3AFileSystem.open(S3AFileSystem.java:1441)\n\tat
org.apache.hadoop.fs.FileSystem.open(FileSystem.java:976)\n\tat
org.apache.iceberg.hadoop.HadoopInputFile.newStream(HadoopInputFile.java:183)\n\t...
41 more\n","message":"Failed to open input s
tream for file: s3a://<>/<>/<>_events
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
