yogevyuval commented on PR #2004: URL: https://github.com/apache/iceberg-python/pull/2004#issuecomment-3094818584
> @yogevyuval Thanks for asking, and yes, I do expect performance impact since just a part of the deserialization is cythonized. With this change, much more is pushed into Rust. This will also reduce the GIL pressure since we don't have to build the readers anymore :) > > I left this PR small to focus on the essentials, but once this is in, we can also clean up a LOT of code 👍 Interesting, we have quite a bit of concurrency going on so curious to see the results. Once https://github.com/apache/iceberg-rust/pull/1328 gets merged and release i'll try and create some basic benchmarks and share the results -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
