Skip to content

[SPARK-55423][INFRA] Set strategy.max-parrallel to 20 for all GitHub Action jobs#54204

Closed
dongjoon-hyun wants to merge 1 commit intoapache:masterfrom
dongjoon-hyun:SPARK-55423
Closed

[SPARK-55423][INFRA] Set strategy.max-parrallel to 20 for all GitHub Action jobs#54204
dongjoon-hyun wants to merge 1 commit intoapache:masterfrom
dongjoon-hyun:SPARK-55423

Conversation

@dongjoon-hyun
Copy link
Copy Markdown
Member

@dongjoon-hyun dongjoon-hyun commented Feb 8, 2026

What changes were proposed in this pull request?

This PR aims to set strategy.max-parrallel to 20 for all GitHub Action jobs.

Why are the changes needed?

ASF Infra team directly requested us via email in (private@spark) mailing list.

Here is GitHub Action syntax.

Screenshot 2026-02-07 at 21 09 02

Does this PR introduce any user-facing change?

No Apache Spark behavior change.

  • Technically, for the PR builder, we use more 20 jobs on the PR contributor's GitHub repo. This job will be limited.

How was this patch tested?

Pass the CIs.

Was this patch authored or co-authored using generative AI tooling?

Generated-by: Opus 4.5 on Claude Code

@github-actions
Copy link
Copy Markdown

github-actions bot commented Feb 8, 2026

JIRA Issue Information

=== Sub-task SPARK-55423 ===
Summary: Set strategy.max-parrallel to 20 for all GitHub Action jobs
Assignee: None
Status: Open
Affected: ["4.2.0"]


This comment was automatically generated by GitHub Actions

@github-actions github-actions bot added the INFRA label Feb 8, 2026
@dongjoon-hyun
Copy link
Copy Markdown
Member Author

dongjoon-hyun commented Feb 8, 2026

cc @HyukjinKwon, @zhengruifeng , @yaooqinn

@dongjoon-hyun
Copy link
Copy Markdown
Member Author

Thank you, @yaooqinn ~ Merged to master/4.1/4.0/3.5.

dongjoon-hyun added a commit that referenced this pull request Feb 8, 2026
…b Action jobs

### What changes were proposed in this pull request?

This PR aims to set `strategy.max-parrallel` to 20 for all GitHub Action jobs.

### Why are the changes needed?

ASF Infra team directly requested us via email in (privatespark) mailing list.

- https://lists.apache.org/thread/voqz9tp3m8wj00lp0y81n25qgvc90f3q

Here is `GitHub Action` syntax.
- https://docs.github.com/en/actions/reference/workflows-and-actions/workflow-syntax#jobsjob_idstrategymax-parallel

<img width="762" height="112" alt="Screenshot 2026-02-07 at 21 09 02" src="https://github.com/user-attachments/assets/770d1b81-390b-49d1-8518-70cb20eb93af" />

### Does this PR introduce _any_ user-facing change?

No Apache Spark behavior change.
- Technically, for the PR builder, we use more 20 jobs on the PR contributor's GitHub repo. This job will be limited.

### How was this patch tested?

Pass the CIs.

### Was this patch authored or co-authored using generative AI tooling?

Generated-by: `Opus 4.5` on `Claude Code`

Closes #54204 from dongjoon-hyun/SPARK-55423.

Authored-by: Dongjoon Hyun <dongjoon@apache.org>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
(cherry picked from commit de34528)
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
dongjoon-hyun added a commit that referenced this pull request Feb 8, 2026
…b Action jobs

### What changes were proposed in this pull request?

This PR aims to set `strategy.max-parrallel` to 20 for all GitHub Action jobs.

### Why are the changes needed?

ASF Infra team directly requested us via email in (privatespark) mailing list.

- https://lists.apache.org/thread/voqz9tp3m8wj00lp0y81n25qgvc90f3q

Here is `GitHub Action` syntax.
- https://docs.github.com/en/actions/reference/workflows-and-actions/workflow-syntax#jobsjob_idstrategymax-parallel

<img width="762" height="112" alt="Screenshot 2026-02-07 at 21 09 02" src="https://github.com/user-attachments/assets/770d1b81-390b-49d1-8518-70cb20eb93af" />

### Does this PR introduce _any_ user-facing change?

No Apache Spark behavior change.
- Technically, for the PR builder, we use more 20 jobs on the PR contributor's GitHub repo. This job will be limited.

### How was this patch tested?

Pass the CIs.

### Was this patch authored or co-authored using generative AI tooling?

Generated-by: `Opus 4.5` on `Claude Code`

Closes #54204 from dongjoon-hyun/SPARK-55423.

Authored-by: Dongjoon Hyun <dongjoon@apache.org>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
(cherry picked from commit de34528)
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
dongjoon-hyun added a commit that referenced this pull request Feb 8, 2026
…b Action jobs

This PR aims to set `strategy.max-parrallel` to 20 for all GitHub Action jobs.

ASF Infra team directly requested us via email in (privatespark) mailing list.

- https://lists.apache.org/thread/voqz9tp3m8wj00lp0y81n25qgvc90f3q

Here is `GitHub Action` syntax.
- https://docs.github.com/en/actions/reference/workflows-and-actions/workflow-syntax#jobsjob_idstrategymax-parallel

<img width="762" height="112" alt="Screenshot 2026-02-07 at 21 09 02" src="https://github.com/user-attachments/assets/770d1b81-390b-49d1-8518-70cb20eb93af" />

No Apache Spark behavior change.
- Technically, for the PR builder, we use more 20 jobs on the PR contributor's GitHub repo. This job will be limited.

Pass the CIs.

Generated-by: `Opus 4.5` on `Claude Code`

Closes #54204 from dongjoon-hyun/SPARK-55423.

Authored-by: Dongjoon Hyun <dongjoon@apache.org>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
(cherry picked from commit de34528)
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
@dongjoon-hyun dongjoon-hyun deleted the SPARK-55423 branch February 8, 2026 05:59
dongjoon-hyun added a commit to apache/spark-kubernetes-operator that referenced this pull request Feb 8, 2026
…n jobs

### What changes were proposed in this pull request?

This PR aims to set `strategy.max-parrallel` to 20 for all GitHub Action jobs.

### Why are the changes needed?

To be consistent with Apache Spark main repository.
- apache/spark#54204

Here is `GitHub Action` syntax.
- https://docs.github.com/en/actions/reference/workflows-and-actions/workflow-syntax#jobsjob_idstrategymax-parallel

<img width="762" height="112" alt="Screenshot 2026-02-07 at 21 09 02" src="https://github.com/user-attachments/assets/770d1b81-390b-49d1-8518-70cb20eb93af" />

### Does this PR introduce _any_ user-facing change?

No Apache Spark behavior change.

### How was this patch tested?

Pass the CIs.

### Was this patch authored or co-authored using generative AI tooling?

Generated-by: `Opus 4.5` on `Claude Code`

Closes #493 from dongjoon-hyun/SPARK-55425.

Authored-by: Dongjoon Hyun <dongjoon@apache.org>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
@zhengruifeng
Copy link
Copy Markdown
Contributor

Late LGTM, thanks @dongjoon-hyun for taking care of this

dongjoon-hyun added a commit to apache/spark-connect-swift that referenced this pull request Feb 8, 2026
…n jobs

### What changes were proposed in this pull request?

This PR aims to set `strategy.max-parrallel` to 20 for all GitHub Action jobs.

### Why are the changes needed?

To be consistent with Apache Spark main repository although we don't have such a job.
- apache/spark#54204

Here is `GitHub Action` syntax.
- https://docs.github.com/en/actions/reference/workflows-and-actions/workflow-syntax#jobsjob_idstrategymax-parallel

<img width="762" height="112" alt="Screenshot 2026-02-07 at 21 09 02" src="https://github.com/user-attachments/assets/770d1b81-390b-49d1-8518-70cb20eb93af" />

### Does this PR introduce _any_ user-facing change?

No Apache Spark behavior change.

### How was this patch tested?

Pass the CIs.

### Was this patch authored or co-authored using generative AI tooling?

Generated-by: `Opus 4.5` on `Claude Code`

Closes #287 from dongjoon-hyun/SPARK-55426.

Authored-by: Dongjoon Hyun <dongjoon@apache.org>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
@dongjoon-hyun
Copy link
Copy Markdown
Member Author

Thank you, @zhengruifeng ~

Yicong-Huang pushed a commit to Yicong-Huang/spark that referenced this pull request Feb 8, 2026
…b Action jobs

### What changes were proposed in this pull request?

This PR aims to set `strategy.max-parrallel` to 20 for all GitHub Action jobs.

### Why are the changes needed?

ASF Infra team directly requested us via email in (privatespark) mailing list.

- https://lists.apache.org/thread/voqz9tp3m8wj00lp0y81n25qgvc90f3q

Here is `GitHub Action` syntax.
- https://docs.github.com/en/actions/reference/workflows-and-actions/workflow-syntax#jobsjob_idstrategymax-parallel

<img width="762" height="112" alt="Screenshot 2026-02-07 at 21 09 02" src="https://github.com/user-attachments/assets/770d1b81-390b-49d1-8518-70cb20eb93af" />

### Does this PR introduce _any_ user-facing change?

No Apache Spark behavior change.
- Technically, for the PR builder, we use more 20 jobs on the PR contributor's GitHub repo. This job will be limited.

### How was this patch tested?

Pass the CIs.

### Was this patch authored or co-authored using generative AI tooling?

Generated-by: `Opus 4.5` on `Claude Code`

Closes apache#54204 from dongjoon-hyun/SPARK-55423.

Authored-by: Dongjoon Hyun <dongjoon@apache.org>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
rpnkv pushed a commit to rpnkv/spark that referenced this pull request Feb 18, 2026
…b Action jobs

### What changes were proposed in this pull request?

This PR aims to set `strategy.max-parrallel` to 20 for all GitHub Action jobs.

### Why are the changes needed?

ASF Infra team directly requested us via email in (privatespark) mailing list.

- https://lists.apache.org/thread/voqz9tp3m8wj00lp0y81n25qgvc90f3q

Here is `GitHub Action` syntax.
- https://docs.github.com/en/actions/reference/workflows-and-actions/workflow-syntax#jobsjob_idstrategymax-parallel

<img width="762" height="112" alt="Screenshot 2026-02-07 at 21 09 02" src="https://github.com/user-attachments/assets/770d1b81-390b-49d1-8518-70cb20eb93af" />

### Does this PR introduce _any_ user-facing change?

No Apache Spark behavior change.
- Technically, for the PR builder, we use more 20 jobs on the PR contributor's GitHub repo. This job will be limited.

### How was this patch tested?

Pass the CIs.

### Was this patch authored or co-authored using generative AI tooling?

Generated-by: `Opus 4.5` on `Claude Code`

Closes apache#54204 from dongjoon-hyun/SPARK-55423.

Authored-by: Dongjoon Hyun <dongjoon@apache.org>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants