andygrove commented on issue #6050: URL: https://github.com/apache/datafusion-comet/issues/6050#issuecomment-5850509360
Done in #6054, which took option 1. The driver plugin now warns at startup when neither `spark.executor.memoryOverhead` nor an overhead factor is set, and #6198 refined when it warns. Options 2 and 3 cannot work on Spark 3.4 to 4.0, because the container is sized from the default ResourceProfile before any plugin runs. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
