RussellSpitzer commented on issue #11393: URL: https://github.com/apache/iceberg/issues/11393#issuecomment-2751788380
You are setting driver heap size a bit too late. If you want to change the driver JVM size (which you must do for local mode) you need to do it in the JVM arguements of the app launch itself and you can't do it in the Spark Session. The reason why is that LOCAL mode doesn't start new JVMs so spark properties about memory are essentially just ignored -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org