Skip to content

[SPARK-54828][PYTHON][INFRA] Set up a scheduled builder for free-threaded Python 3.14#53588

Closed
zhengruifeng wants to merge 2 commits intoapache:masterfrom
zhengruifeng:python_314_no_gil
Closed

[SPARK-54828][PYTHON][INFRA] Set up a scheduled builder for free-threaded Python 3.14#53588
zhengruifeng wants to merge 2 commits intoapache:masterfrom
zhengruifeng:python_314_no_gil

Conversation

@zhengruifeng
Copy link
Copy Markdown
Contributor

@zhengruifeng zhengruifeng commented Dec 24, 2025

What changes were proposed in this pull request?

Set up a scheduled builder for free-threaded Python 3.14

Why are the changes needed?

to monitor the support of no-gil

Does this PR introduce any user-facing change?

no

How was this patch tested?

PR builder with

default: '{"PYSPARK_IMAGE_TO_TEST": "python-314-nogil", "PYTHON_TO_TEST": "python3.14t", "PYTHON_GIL": "0"}'

https://github.com/zhengruifeng/spark/actions/runs/20477205646/job/58844457177

note that some packages are not compatible with no-gil, and some tests are skipped with PYTHON_GIL=0

Was this patch authored or co-authored using generative AI tooling?

no

@zhengruifeng zhengruifeng marked this pull request as draft December 24, 2025 04:49
required: false
type: string
default: '{"PYSPARK_IMAGE_TO_TEST": "python-311", "PYTHON_TO_TEST": "python3.11"}'
default: '{"PYSPARK_IMAGE_TO_TEST": "python-314-nogil", "PYTHON_TO_TEST": "python3.14t", "PYTHON_GIL": "0"}'
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

So what does this line mean? Do we convert any default to 3.14t now?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is to check the new image via PR builder, will revert it before merge

@zhengruifeng zhengruifeng marked this pull request as ready for review December 24, 2025 08:02
@zhengruifeng
Copy link
Copy Markdown
Contributor Author

merged to master

@zhengruifeng zhengruifeng deleted the python_314_no_gil branch December 24, 2025 12:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants