Skip to content

Commit 276fede

Browse files
committed
[SPARK-7008][INFRA][PS] Upgrade pyarrow to 15.0 in image python-ps-minimum
### What changes were proposed in this pull request? Upgrade pyarrow to 15.0 in image python-ps-minimum ### Why are the changes needed? features from newer versions of pyarrow has been used recently ### Does this PR introduce _any_ user-facing change? no ### How was this patch tested? pr builder with: ``` default: '{"PYSPARK_IMAGE_TO_TEST": "python-ps-minimum", "PYTHON_TO_TEST": "python3.10"}' ``` see https://github.com/zhengruifeng/spark/actions/runs/16486274287/job/46611454898 ### Was this patch authored or co-authored using generative AI tooling? no Closes #51645 from zhengruifeng/ps_arrow_15. Authored-by: Ruifeng Zheng <ruifengz@apache.org> Signed-off-by: Ruifeng Zheng <ruifengz@apache.org>
1 parent c4c0db0 commit 276fede

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

dev/spark-test-image/python-ps-minimum/Dockerfile

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -62,7 +62,7 @@ RUN apt-get update && apt-get install -y \
6262
zlib1g-dev
6363

6464

65-
ARG BASIC_PIP_PKGS="pyarrow==11.0.0 pandas==2.2.0 six==1.16.0 numpy scipy coverage unittest-xml-reporting"
65+
ARG BASIC_PIP_PKGS="pyarrow==15.0.0 pandas==2.2.0 six==1.16.0 numpy scipy coverage unittest-xml-reporting"
6666
# Python deps for Spark Connect
6767
ARG CONNECT_PIP_PKGS="grpcio==1.67.0 grpcio-status==1.67.0 googleapis-common-protos==1.65.0 graphviz==0.20 protobuf"
6868

0 commit comments

Comments
 (0)