koenvo commented on issue #2138: URL: https://github.com/apache/iceberg-python/issues/2138#issuecomment-2997190853
> [@mwa28](https://github.com/mwa28) Thanks for raising this. 10240 is a lot of memory, and doesn't sound right. > > Luckily [@koenvo](https://github.com/koenvo) ran into the same issue, and pushed a fix, which got merged recently: [#1995](https://github.com/apache/iceberg-python/pull/1995). Any chance to try out that implementation? It hasn't been released, but it would be good to try it out in production cases. Curious how these changes impact the memory usage in your case. Would it be possible to add the partition key to your join_keys? Maybe we could always add partition keys when not passed as join_keys yet..? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
