jotarada opened a new issue, #12554:
URL: https://github.com/apache/iceberg/issues/12554

   ### Apache Iceberg version
   
   1.8.1 (latest release)
   
   ### Query engine
   
   None
   
   ### Please describe the bug 🐞
   
   I think this a bug produced by 
[11555](https://github.com/apache/iceberg/pull/11555)
   While running rewrite_table_path and moving the data with a delete file i 
got the error 
   ```
   Error: TrinoExternalError(type=EXTERNAL, name=ICEBERG_CANNOT_OPEN_SPLIT,
    message="Error opening Iceberg split 
gs://buket/dir/data/id_trunc_2=3e/20250305_141051_06175_fjupa-4a03af2a-12c4-4f27-881b-bc15f459b13c.parquet
 
    (offset=0, length=1187): Read 1187 tail bytes of file 
    
gs://buket/dir/data/id_trunc_2=3e/20250305_141051_06175_fjupa-4a03af2a-12c4-4f27-881b-bc15f459b13c.parquet
 failed: Incorrect file size (1187) for file (end of stream not reached): 
gs://buket/dir/data/id_trunc_2=3e/20250305_141051_06175_fjupa-4a03af2a-12c4-4f27-881b-bc15f459b13c.parquet",
 query_id=20250317_151116_30308_u8j29)
   ```
   
   Seems like this happens because the file 
`20250305_141051_06175_fjupa-4a03af2a-12c4-4f27-881b-bc15f459b13c.parquet` was 
rewritten (is a delete file) but the info on the manifest was not 
   ```
    "file_sequence_number": null,
     "data_file": {
       "content": 1,
       "file_path": 
"gs://buket/dir/data/id_trunc_2=3e/20250305_141051_06175_fjupa-4a03af2a-12c4-4f27-881b-bc15f459b13c.parquet",
       "file_format": "PARQUET",
       "partition": {
         "id_trunc_2": {
           "string": "3e"
         }
       },
       "record_count": 1,
       "file_size_in_bytes": 1187,
       "column_sizes": {
         "array": [
           {
             "key": 2147483546,
             "value": 199
           },
           {
             "key": 2147483545,
             "value": 27
           }
         ]
       },
   ```
   
   1187 was the size of the parquet file before rewritten, the new size is 
1799, but that value is not updated
   
   ### Willingness to contribute
   
   - [ ] I can contribute a fix for this bug independently
   - [ ] I would be willing to contribute a fix for this bug with guidance from 
the Iceberg community
   - [x] I cannot contribute a fix for this bug at this time


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org

Reply via email to