Skip to content

[SPARK-55518][INFRA][PYTHON][DOCS] Upgrade Python to 3.12 in doc build#54310

Closed
zhengruifeng wants to merge 2 commits intoapache:masterfrom
zhengruifeng:doc_py312
Closed

[SPARK-55518][INFRA][PYTHON][DOCS] Upgrade Python to 3.12 in doc build#54310
zhengruifeng wants to merge 2 commits intoapache:masterfrom
zhengruifeng:doc_py312

Conversation

@zhengruifeng
Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

Upgrade Python to 3.12 in doc build

Why are the changes needed?

1, Upgrade Python to 3.12 in doc build;
2, Unpin pyzmq<24.0.0 introduced in #37904 for python linter, otherwise the python installation fails

Does this PR introduce any user-facing change?

No, infra-only

How was this patch tested?

CI, the PR builder should cover this change

Was this patch authored or co-authored using generative AI tooling?

No

run: python3.9 -m pip list
- name: List Python packages for branch-4.1
if: inputs.branch == 'branch-4.1'
run: python3.11 -m pip list
Copy link
Copy Markdown
Member

@dongjoon-hyun dongjoon-hyun Feb 13, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For my understanding: This PR seems to remove Python 3.11 installation step in the Docker file for branch-4.1. Where does this python 3.11 come from?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This PR seems to remove Python 3.11 installation step in the Docker file for branch-4.1

I guess it is using a different image, since github.ref_name is used as the tag

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

let me check it with a 4.1 PR

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I see this in step initialize container

Starting job container
  /usr/bin/docker --config /home/runner/work/_temp/.docker_1e82e198-95d9-412d-9a06-2c22a7072071 login ghcr.io -u zhengruifeng --password-stdin
  /usr/bin/docker --config /home/runner/work/_temp/.docker_1e82e198-95d9-412d-9a06-2c22a7072071 pull ghcr.io/zhengruifeng/apache-spark-ci-image-docs:branch-4.1-22123192824

https://github.com/zhengruifeng/spark/actions/runs/22123192824/job/63947748574

Copy link
Copy Markdown
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for checking. +1, LGTM.

@HyukjinKwon
Copy link
Copy Markdown
Member

Merged to master.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants