aiborodin commented on PR #13394: URL: https://github.com/apache/iceberg/pull/13394#issuecomment-3087156206
I still like the idea of having a clean API with a stream of `DynamicRecord` as an input. But, unfortunately, it seems there's no easy way to implement this, given that Flink serialises records between subtasks by default. We would probably need to implement a custom, performant serialiser to fix this. Is it okay if we keep it open for a bit to experiment with other ideas? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
