mgmarino commented on PR #12129: URL: https://github.com/apache/iceberg/pull/12129#issuecomment-2660002476
Hi @Fokko, yes, it could be that the underlying issue is the same (i.e. Spark moving the SerializedTable to disk and closing the IO that is still in use). I will see if I can figure out how to write a test here, the issue is to trigger Spark to move broadcast variables to disk. I'll see if I can find a test in the Spark code base to guide me. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
