felixscherz opened a new pull request, #650: URL: https://github.com/apache/iceberg-python/pull/650
Hi, this is in regards to #596 and still WIP. The `RollingManifestWriter` implementation closely follows the java [implementation](https://github.com/apache/iceberg/blob/main/core/src/main/java/org/apache/iceberg/RollingManifestWriter.java). It takes in a generator that produces `ManifestWriter` objects and rolls over to a new one once either the number of rows appended or the file size in bytes exceeds the target value. It's not finished as of yet, I am still trying to find a good way to access the current file from the underlying reader. I tried to obtain that information from the `ManifestWriter._writer.output_stream` object, but that is write-only. Any pointers on how to access the current file size of the manifest writer would help me a lot:) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
