nagraham opened a new issue, #1406: URL: https://github.com/apache/iceberg-rust/issues/1406
### Context I'm working on writing data to R2 Data Catalog (https://developers.cloudflare.com/r2/data-catalog/) with iceberg-rust (I'm on the R2 Data Catalog team). ### Problem When writing large files into the Iceberg table , I get the following error: ``` S3Error { code: "InvalidPart", message: "All non-trailing parts must have the same length.", resource: "", request_id: "" } ``` I had traced the problem to OpenDAL, and opened an issue there: https://github.com/apache/opendal/issues/6252. ### Desired Result Writing large files (files large enough to require a multipart upload) to an Iceberg Table hosted in Cloudflare R2 should succeed. A possible solution seems to be to add a `chunk()` to the writer process to ensure each uploaded part (aside from the last) has the same size. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
