Skip to content

Commit 0f295cb

Browse files
committed
[SPARK-55172][PYTHON][INFRA] Remove unused packages from python 3.12 test image
### What changes were proposed in this pull request? Remove unused packages from python test images ### Why are the changes needed? clean up and 1GB more for test before ``` Filesystem Size Used Avail Use% Mounted on overlay 72G 48G 24G 67% / tmpfs 64M 0 64M 0% /dev shm 64M 0 64M 0% /dev/shm /dev/root 72G 48G 24G 67% /__t tmpfs 3.2G 1.1M 3.2G 1% /run/docker.sock tmpfs 7.9G 0 7.9G 0% /proc/acpi tmpfs 7.9G 0 7.9G 0% /proc/scsi tmpfs 7.9G 0 7.9G 0% /sys/firmware ``` after ``` Filesystem Size Used Avail Use% Mounted on overlay 72G 48G 25G 67% / tmpfs 64M 0 64M 0% /dev shm 64M 0 64M 0% /dev/shm /dev/root 72G 48G 25G 67% /__w tmpfs 3.2G 1.1M 3.2G 1% /run/docker.sock tmpfs 7.9G 0 7.9G 0% /proc/acpi tmpfs 7.9G 0 7.9G 0% /proc/scsi tmpfs 7.9G 0 7.9G 0% /sys/firmware ``` ### Does this PR introduce _any_ user-facing change? No, infra-only ### How was this patch tested? CI ### Was this patch authored or co-authored using generative AI tooling? No Closes #53955 from zhengruifeng/image_clean_up. Authored-by: Ruifeng Zheng <[email protected]> Signed-off-by: Ruifeng Zheng <[email protected]>
1 parent 78ec6f7 commit 0f295cb

File tree

1 file changed

+1
-14
lines changed

1 file changed

+1
-14
lines changed

dev/spark-test-image/python-312/Dockerfile

Lines changed: 1 addition & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -24,7 +24,7 @@ LABEL org.opencontainers.image.ref.name="Apache Spark Infra Image For PySpark wi
2424
# Overwrite this label to avoid exposing the underlying Ubuntu OS version label
2525
LABEL org.opencontainers.image.version=""
2626

27-
ENV FULL_REFRESH_DATE=20250618
27+
ENV FULL_REFRESH_DATE=20260124
2828

2929
ENV DEBIAN_FRONTEND=noninteractive
3030
ENV DEBCONF_NONINTERACTIVE_SEEN=true
@@ -36,27 +36,14 @@ RUN apt-get update && apt-get install -y \
3636
gfortran \
3737
git \
3838
gnupg \
39-
libcurl4-openssl-dev \
40-
libfontconfig1-dev \
41-
libfreetype6-dev \
42-
libfribidi-dev \
4339
libgit2-dev \
44-
libharfbuzz-dev \
45-
libjpeg-dev \
4640
liblapack-dev \
4741
libopenblas-dev \
48-
libpng-dev \
49-
libpython3-dev \
5042
libssl-dev \
51-
libtiff5-dev \
52-
libwebp-dev \
53-
libxml2-dev \
5443
openjdk-17-jdk-headless \
5544
pkg-config \
56-
qpdf \
5745
tzdata \
5846
software-properties-common \
59-
wget \
6047
zlib1g-dev
6148

6249
# Install Python 3.12

0 commit comments

Comments
 (0)