Skip to content

Commit 9823daf

Browse files
committed
[SPARK-53931][INFRA][PYTHON] Fix scheduled job for numpy 2.1.3
### What changes were proposed in this pull request? Fix scheduled job for numpy 2.1.3 ### Why are the changes needed? to fix https://github.com/apache/spark/actions/runs/18538043179/job/52838303733 it was caused by a bug in 19.0.0, see apache/arrow#45283 ### Does this PR introduce _any_ user-facing change? no, infra-only ### How was this patch tested? PR builder with ``` default: '{"PYSPARK_IMAGE_TO_TEST": "numpy-213", "PYTHON_TO_TEST": "python3.11"}' ``` see https://github.com/zhengruifeng/spark/actions/runs/18527303212/job/52801019275 ### Was this patch authored or co-authored using generative AI tooling? no Closes #52633 from zhengruifeng/restore_numpy_213. Authored-by: Ruifeng Zheng <[email protected]> Signed-off-by: Ruifeng Zheng <[email protected]>
1 parent 61a024c commit 9823daf

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

dev/spark-test-image/numpy-213/Dockerfile

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -68,7 +68,7 @@ RUN apt-get update && apt-get install -y \
6868

6969

7070
# Pin numpy==2.1.3
71-
ARG BASIC_PIP_PKGS="numpy==2.1.3 pyarrow==19.0.0 six==1.16.0 pandas==2.2.3 scipy plotly<6.0.0 mlflow>=2.8.1 coverage matplotlib openpyxl memory-profiler>=0.61.0 scikit-learn>=1.3.2"
71+
ARG BASIC_PIP_PKGS="numpy==2.1.3 pyarrow>=21.0.0 six==1.16.0 pandas==2.2.3 scipy plotly<6.0.0 mlflow>=2.8.1 coverage matplotlib openpyxl memory-profiler>=0.61.0 scikit-learn>=1.3.2"
7272
# Python deps for Spark Connect
7373
ARG CONNECT_PIP_PKGS="grpcio==1.67.0 grpcio-status==1.67.0 protobuf==5.29.5 googleapis-common-protos==1.65.0 graphviz==0.20.3"
7474

0 commit comments

Comments
 (0)