dyno opened a new issue, #14195:
URL: https://github.com/apache/iceberg/issues/14195

   ### Apache Iceberg version
   
   1.9.2
   
   ### Query engine
   
   Spark
   
   ### Please describe the bug 🐞
   
   exhibit of the error
   ```
   org.apache.iceberg.exceptions.NotFoundException: Failed to open input stream 
for file: 
s3://../metadata/snap-4660682404109470240-1-f4d9449a-5f85-4391-a4ab-2db223be2646.avro
           at 
org.apache.iceberg.hadoop.HadoopInputFile.newStream(HadoopInputFile.java:185) 
~[iceberg-spark-runtime-3.5_2.12-1.9.2.jar:?]
           at 
org.apache.iceberg.avro.AvroIterable.newFileReader(AvroIterable.java:102) 
~[iceberg-spark-runtime-3.5_2.12-1.9.2.jar:?]
           at 
org.apache.iceberg.avro.AvroIterable.iterator(AvroIterable.java:77) 
~[iceberg-spark-runtime-3.5_2.12-1.9.2.jar:?]
           at 
org.apache.iceberg.avro.AvroIterable.iterator(AvroIterable.java:37) 
~[iceberg-spark-runtime-3.5_2.12-1.9.2.jar:?]
           at 
org.apache.iceberg.relocated.com.google.common.collect.Iterables.addAll(Iterables.java:332)
 ~[iceberg-spark-runtime-3.5_2.12-1.9.2.jar:?]
           at 
org.apache.iceberg.relocated.com.google.common.collect.Lists.newLinkedList(Lists.java:261)
 ~[iceberg-spark-runtime-3.5_2.12-1.9.2.jar:?]
           at org.apache.iceberg.ManifestLists.read(ManifestLists.java:42) 
~[iceberg-spark-runtime-3.5_2.12-1.9.2.jar:?]
           at 
org.apache.iceberg.BaseSnapshot.cacheManifests(BaseSnapshot.java:176) 
~[iceberg-spark-runtime-3.5_2.12-1.9.2.jar:?]
           at 
org.apache.iceberg.BaseSnapshot.dataManifests(BaseSnapshot.java:202) 
~[iceberg-spark-runtime-3.5_2.12-1.9.2.jar:?]
           at 
org.apache.iceberg.MergingSnapshotProducer.apply(MergingSnapshotProducer.java:920)
 ~[iceberg-spark-runtime-3.5_2.12-1.9.2.jar:?]
           at 
org.apache.iceberg.BaseOverwriteFiles.apply(BaseOverwriteFiles.java:30) 
~[iceberg-spark-runtime-3.5_2.12-1.9.2.jar:?]
           at 
org.apache.iceberg.SnapshotProducer.apply(SnapshotProducer.java:261) 
~[iceberg-spark-runtime-3.5_2.12-1.9.2.jar:?]
           at 
org.apache.iceberg.BaseOverwriteFiles.apply(BaseOverwriteFiles.java:30) 
~[iceberg-spark-runtime-3.5_2.12-1.9.2.jar:?]
           at 
org.apache.iceberg.SnapshotProducer.lambda$commit$2(SnapshotProducer.java:439) 
~[iceberg-spark-runtime-3.5_2.12-1.9.2.jar:?]
           at 
org.apache.iceberg.util.Tasks$Builder.runTaskWithRetry(Tasks.java:413) 
~[iceberg-spark-runtime-3.5_2.12-1.9.2.jar:?]
           at 
org.apache.iceberg.util.Tasks$Builder.runSingleThreaded(Tasks.java:219) 
~[iceberg-spark-runtime-3.5_2.12-1.9.2.jar:?]
           at org.apache.iceberg.util.Tasks$Builder.run(Tasks.java:203) 
~[iceberg-spark-runtime-3.5_2.12-1.9.2.jar:?]
           at org.apache.iceberg.util.Tasks$Builder.run(Tasks.java:196) 
~[iceberg-spark-runtime-3.5_2.12-1.9.2.jar:?]
           at 
org.apache.iceberg.SnapshotProducer.commit(SnapshotProducer.java:437) 
~[iceberg-spark-runtime-3.5_2.12-1.9.2.jar:?]
           at 
org.apache.iceberg.BaseOverwriteFiles.commit(BaseOverwriteFiles.java:30) 
~[iceberg-spark-runtime-3.5_2.12-1.9.2.jar:?]
           at 
org.apache.iceberg.spark.source.SparkWrite.commitOperation(SparkWrite.java:233) 
~[iceberg-spark-runtime-3.5_2.12-1.9.2.jar:?]
           at 
org.apache.iceberg.spark.source.SparkWrite$OverwriteByFilter.commit(SparkWrite.java:378)
 ~[iceberg-spark-runtime-3.5_2.12-1.9.2.jar:?]
   ```
   on disk
   ```
   TZ=UTC aws s3 ls  s3://../metadata/ | sort
   
   2025-09-26 00:59:25      15535 f4d9449a-5f85-4391-a4ab-2db223be2646-m1.avro
   2025-09-26 00:59:25      5658  
snap-4660682404109470240-2-f4d9449a-5f85-4391-a4ab-2db223be2646.avro 
   ```
   it's like metadata.json points to a manifestlist file of first attempt. 
   
   before this happen, i do see write failure. 
   
   ```
   applog-1175          o.a.s.s.e.d.v.OverwriteByExpressionExec:76] Data source 
write support 
IcebergBatchWrite(table=spark_catalog.applogs_iceberg_internal.fact_applogs_tuerr_current_tokenized,
 format=PARQUET) is aborting.
   ```
   
   ### Willingness to contribute
   
   - [ ] I can contribute a fix for this bug independently
   - [x] I would be willing to contribute a fix for this bug with guidance from 
the Iceberg community
   - [ ] I cannot contribute a fix for this bug at this time


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to