mattmartin14 commented on issue #1759: URL: https://github.com/apache/iceberg-python/issues/1759#issuecomment-2712180183
I encountered this issue when writing the upsert method. If your join column is a single column, then the function scales fine and won't hit a recursion limit. I stressed tested a single column join on 1M rows and it handled it. Where the issue lies is on composite keys (2 or more columns to join on). I was not able to work on the visitor function that builds out the overwrite predicate but that is the function that needs work and needs to get away from using recursion to find all the recs to overwrite -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
