This is an automated email from the ASF dual-hosted git repository.
yangjie01 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 3e2470de7ea [SPARK-45536][BUILD] Lower the default `-Xmx` of
`build/mvn` to 3g
3e2470de7ea is described below
commit 3e2470de7ea8b97dcdd8875ef25f044998fb7588
Author: yangjie01 <[email protected]>
AuthorDate: Fri Oct 13 22:55:19 2023 +0800
[SPARK-45536][BUILD] Lower the default `-Xmx` of `build/mvn` to 3g
### What changes were proposed in this pull request?
This pr lower the default `-Xmx` of `build/mvn` from 4g to 3g to reduce the
peak memory usage of Maven compilation.
### Why are the changes needed?
This can potentially fix the snapshot build being failed:
https://github.com/apache/spark/actions/runs/6502277099
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
- Manual check.
run
```
build/mvn clean install -DskipTests -Pyarn -Pkubernetes -Pvolcano -Phive
-Phive-thriftserver -Pspark-ganglia-lgpl -Phadoop-cloud
```
**Before**
Peak memory usage is at 6.1GB.
**After**
Peak memory usage is at 5GB, but the compilation time has increased by 10%.
### Was this patch authored or co-authored using generative AI tooling?
No
Closes #43364 from LuciferYang/r-xmx-3g.
Authored-by: yangjie01 <[email protected]>
Signed-off-by: yangjie01 <[email protected]>
---
build/mvn | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/build/mvn b/build/mvn
index 3179099304c..ad753833c69 100755
--- a/build/mvn
+++ b/build/mvn
@@ -36,7 +36,7 @@ _DIR="$( cd "$( dirname "${BASH_SOURCE[0]}" )" && pwd )"
# Preserve the calling directory
_CALLING_DIR="$(pwd)"
# Options used during compilation
-_COMPILE_JVM_OPTS="-Xss128m -Xmx4g -XX:ReservedCodeCacheSize=128m"
+_COMPILE_JVM_OPTS="-Xss128m -Xmx3g -XX:ReservedCodeCacheSize=128m"
# Installs any application tarball given a URL, the expected tarball name,
# and, optionally, a checkable binary path to determine if the binary has
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
