This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-4.1
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-4.1 by this push:
new d29af1305696 [SPARK-54148][INFRA] Add `libwebp-dev` to all
`dev/spark-test-image/*/Dockerfile`
d29af1305696 is described below
commit d29af1305696471956579c96beb34152620df7e1
Author: Dongjoon Hyun <[email protected]>
AuthorDate: Sun Nov 2 21:05:25 2025 -0800
[SPARK-54148][INFRA] Add `libwebp-dev` to all
`dev/spark-test-image/*/Dockerfile`
### What changes were proposed in this pull request?
This PR aims to add `libwebp-dev` to all
`dev/spark-test-image/*/Dockerfile`.
### Why are the changes needed?
Like we hit this issue before, this happens at all related docker images.
- #52290
- #52838
I checked `dev` directory.
- https://github.com/apache/spark/tree/branch-4.1/dev
To put it simply consistent with `spark-rm/Dockerfile` behavior, we need
this additionally 13 places because `libwebp-dev` is used only 3 times while
`libtiff5-dev` is used 16 times.
```
$ git grep libtiff5-dev dev | wc -l
16
$ git grep libwebp-dev dev | wc -l
3
```
### Does this PR introduce _any_ user-facing change?
No behavior change.
### How was this patch tested?
Manual review.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #52846 from dongjoon-hyun/SPARK-54148.
Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
(cherry picked from commit f5bd5d09dfd3f6fff13ca97724f1766029f0e0eb)
Signed-off-by: Dongjoon Hyun <[email protected]>
---
dev/spark-test-image/docs/Dockerfile | 1 +
dev/spark-test-image/numpy-213/Dockerfile | 1 +
dev/spark-test-image/pypy-310/Dockerfile | 1 +
dev/spark-test-image/python-310/Dockerfile | 1 +
dev/spark-test-image/python-311-classic-only/Dockerfile | 1 +
dev/spark-test-image/python-311/Dockerfile | 1 +
dev/spark-test-image/python-312/Dockerfile | 1 +
dev/spark-test-image/python-313-nogil/Dockerfile | 1 +
dev/spark-test-image/python-313/Dockerfile | 1 +
dev/spark-test-image/python-314/Dockerfile | 1 +
dev/spark-test-image/python-minimum/Dockerfile | 1 +
dev/spark-test-image/python-ps-minimum/Dockerfile | 1 +
dev/spark-test-image/sparkr/Dockerfile | 1 +
13 files changed, 13 insertions(+)
diff --git a/dev/spark-test-image/docs/Dockerfile
b/dev/spark-test-image/docs/Dockerfile
index c4cd43b9eb3b..4c1e68f72447 100644
--- a/dev/spark-test-image/docs/Dockerfile
+++ b/dev/spark-test-image/docs/Dockerfile
@@ -49,6 +49,7 @@ RUN apt-get update && apt-get install -y \
libpython3-dev \
libssl-dev \
libtiff5-dev \
+ libwebp-dev \
libxml2-dev \
nodejs \
npm \
diff --git a/dev/spark-test-image/numpy-213/Dockerfile
b/dev/spark-test-image/numpy-213/Dockerfile
index 116154b663b0..d0409e61a51a 100644
--- a/dev/spark-test-image/numpy-213/Dockerfile
+++ b/dev/spark-test-image/numpy-213/Dockerfile
@@ -49,6 +49,7 @@ RUN apt-get update && apt-get install -y \
libpython3-dev \
libssl-dev \
libtiff5-dev \
+ libwebp-dev \
libxml2-dev \
openjdk-17-jdk-headless \
pkg-config \
diff --git a/dev/spark-test-image/pypy-310/Dockerfile
b/dev/spark-test-image/pypy-310/Dockerfile
index cddf0f8ea10a..6f0b938bd199 100644
--- a/dev/spark-test-image/pypy-310/Dockerfile
+++ b/dev/spark-test-image/pypy-310/Dockerfile
@@ -49,6 +49,7 @@ RUN apt-get update && apt-get install -y \
libpython3-dev \
libssl-dev \
libtiff5-dev \
+ libwebp-dev \
libxml2-dev \
openjdk-17-jdk-headless \
pkg-config \
diff --git a/dev/spark-test-image/python-310/Dockerfile
b/dev/spark-test-image/python-310/Dockerfile
index cfc03bccdf7c..ef59237afee2 100644
--- a/dev/spark-test-image/python-310/Dockerfile
+++ b/dev/spark-test-image/python-310/Dockerfile
@@ -49,6 +49,7 @@ RUN apt-get update && apt-get install -y \
libpython3-dev \
libssl-dev \
libtiff5-dev \
+ libwebp-dev \
libxml2-dev \
openjdk-17-jdk-headless \
pkg-config \
diff --git a/dev/spark-test-image/python-311-classic-only/Dockerfile
b/dev/spark-test-image/python-311-classic-only/Dockerfile
index 6a71317a5fe4..72f7ebec686e 100644
--- a/dev/spark-test-image/python-311-classic-only/Dockerfile
+++ b/dev/spark-test-image/python-311-classic-only/Dockerfile
@@ -49,6 +49,7 @@ RUN apt-get update && apt-get install -y \
libpython3-dev \
libssl-dev \
libtiff5-dev \
+ libwebp-dev \
libxml2-dev \
openjdk-17-jdk-headless \
pkg-config \
diff --git a/dev/spark-test-image/python-311/Dockerfile
b/dev/spark-test-image/python-311/Dockerfile
index 962f6427de6a..25fd065753bd 100644
--- a/dev/spark-test-image/python-311/Dockerfile
+++ b/dev/spark-test-image/python-311/Dockerfile
@@ -49,6 +49,7 @@ RUN apt-get update && apt-get install -y \
libpython3-dev \
libssl-dev \
libtiff5-dev \
+ libwebp-dev \
libxml2-dev \
openjdk-17-jdk-headless \
pkg-config \
diff --git a/dev/spark-test-image/python-312/Dockerfile
b/dev/spark-test-image/python-312/Dockerfile
index afa24025c46c..82016bbec860 100644
--- a/dev/spark-test-image/python-312/Dockerfile
+++ b/dev/spark-test-image/python-312/Dockerfile
@@ -49,6 +49,7 @@ RUN apt-get update && apt-get install -y \
libpython3-dev \
libssl-dev \
libtiff5-dev \
+ libwebp-dev \
libxml2-dev \
openjdk-17-jdk-headless \
pkg-config \
diff --git a/dev/spark-test-image/python-313-nogil/Dockerfile
b/dev/spark-test-image/python-313-nogil/Dockerfile
index c7d2faed010f..7f608caab193 100644
--- a/dev/spark-test-image/python-313-nogil/Dockerfile
+++ b/dev/spark-test-image/python-313-nogil/Dockerfile
@@ -49,6 +49,7 @@ RUN apt-get update && apt-get install -y \
libpython3-dev \
libssl-dev \
libtiff5-dev \
+ libwebp-dev \
libxml2-dev \
openjdk-17-jdk-headless \
pkg-config \
diff --git a/dev/spark-test-image/python-313/Dockerfile
b/dev/spark-test-image/python-313/Dockerfile
index dcc68575c496..9fd53d233ac0 100644
--- a/dev/spark-test-image/python-313/Dockerfile
+++ b/dev/spark-test-image/python-313/Dockerfile
@@ -49,6 +49,7 @@ RUN apt-get update && apt-get install -y \
libpython3-dev \
libssl-dev \
libtiff5-dev \
+ libwebp-dev \
libxml2-dev \
openjdk-17-jdk-headless \
pkg-config \
diff --git a/dev/spark-test-image/python-314/Dockerfile
b/dev/spark-test-image/python-314/Dockerfile
index 5ab4154dd0f7..0ba9b620bd8b 100644
--- a/dev/spark-test-image/python-314/Dockerfile
+++ b/dev/spark-test-image/python-314/Dockerfile
@@ -49,6 +49,7 @@ RUN apt-get update && apt-get install -y \
libpython3-dev \
libssl-dev \
libtiff5-dev \
+ libwebp-dev \
libxml2-dev \
openjdk-17-jdk-headless \
pkg-config \
diff --git a/dev/spark-test-image/python-minimum/Dockerfile
b/dev/spark-test-image/python-minimum/Dockerfile
index 8f42d02023e5..122281ec0ea1 100644
--- a/dev/spark-test-image/python-minimum/Dockerfile
+++ b/dev/spark-test-image/python-minimum/Dockerfile
@@ -50,6 +50,7 @@ RUN apt-get update && apt-get install -y \
libpython3-dev \
libssl-dev \
libtiff5-dev \
+ libwebp-dev \
libxml2-dev \
openjdk-17-jdk-headless \
pkg-config \
diff --git a/dev/spark-test-image/python-ps-minimum/Dockerfile
b/dev/spark-test-image/python-ps-minimum/Dockerfile
index 440fda96f0fc..680697c3f2d7 100644
--- a/dev/spark-test-image/python-ps-minimum/Dockerfile
+++ b/dev/spark-test-image/python-ps-minimum/Dockerfile
@@ -50,6 +50,7 @@ RUN apt-get update && apt-get install -y \
libpython3-dev \
libssl-dev \
libtiff5-dev \
+ libwebp-dev \
libxml2-dev \
openjdk-17-jdk-headless \
pkg-config \
diff --git a/dev/spark-test-image/sparkr/Dockerfile
b/dev/spark-test-image/sparkr/Dockerfile
index 3312c0852bd7..6c0314c051d1 100644
--- a/dev/spark-test-image/sparkr/Dockerfile
+++ b/dev/spark-test-image/sparkr/Dockerfile
@@ -49,6 +49,7 @@ RUN apt-get update && apt-get install -y \
libpython3-dev \
libssl-dev \
libtiff5-dev \
+ libwebp-dev \
libxml2-dev \
pandoc \
pkg-config \
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
