Skip to content

[SPARK-55428][BUILD] Sync Netty Java options everywhere#54209

Closed
pan3793 wants to merge 1 commit intoapache:masterfrom
pan3793:SPARK-55428
Closed

[SPARK-55428][BUILD] Sync Netty Java options everywhere#54209
pan3793 wants to merge 1 commit intoapache:masterfrom
pan3793:SPARK-55428

Conversation

@pan3793
Copy link
Copy Markdown
Member

@pan3793 pan3793 commented Feb 8, 2026

What changes were proposed in this pull request?

Remove redundant -Dio.netty.tryReflectionSetAccessible=true in some building scripts/pom.xml - it has already been added by JavaModuleOptions(spark-submit-based cases) or Maven property extraJavaTestArgs(ScalaTests/JUnit cases)

Add the missing opts to sql/connect/bin/spark-connect-scala-client

-Dio.netty.allocator.type=pooled
-Dio.netty.handler.ssl.defaultEndpointVerificationAlgorithm=NONE

Why are the changes needed?

Keep Netty Java options sync everywhere.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Pass GHA.

Was this patch authored or co-authored using generative AI tooling?

No.

@github-actions
Copy link
Copy Markdown

github-actions bot commented Feb 8, 2026

JIRA Issue Information

=== Improvement SPARK-55428 ===
Summary: Sync Netty JAVA_OPTS everywhere
Assignee: None
Status: Open
Affected: ["4.2.0"]


This comment was automatically generated by GitHub Actions

Copy link
Copy Markdown
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, LGTM (Pending CIs)

Thank you for making this consistently, @pan3793 .

@dongjoon-hyun
Copy link
Copy Markdown
Member

Merged to master.

Yicong-Huang pushed a commit to Yicong-Huang/spark that referenced this pull request Feb 8, 2026
### What changes were proposed in this pull request?

Remove redundant `-Dio.netty.tryReflectionSetAccessible=true` in some building scripts/`pom.xml` - it has already been added by `JavaModuleOptions`(`spark-submit`-based cases) or Maven property `extraJavaTestArgs`(ScalaTests/JUnit cases)

Add the missing opts to `sql/connect/bin/spark-connect-scala-client`

```
-Dio.netty.allocator.type=pooled
-Dio.netty.handler.ssl.defaultEndpointVerificationAlgorithm=NONE
```

### Why are the changes needed?

Keep Netty Java options sync everywhere.

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Pass GHA.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes apache#54209 from pan3793/SPARK-55428.

Authored-by: Cheng Pan <chengpan@apache.org>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
rpnkv pushed a commit to rpnkv/spark that referenced this pull request Feb 18, 2026
### What changes were proposed in this pull request?

Remove redundant `-Dio.netty.tryReflectionSetAccessible=true` in some building scripts/`pom.xml` - it has already been added by `JavaModuleOptions`(`spark-submit`-based cases) or Maven property `extraJavaTestArgs`(ScalaTests/JUnit cases)

Add the missing opts to `sql/connect/bin/spark-connect-scala-client`

```
-Dio.netty.allocator.type=pooled
-Dio.netty.handler.ssl.defaultEndpointVerificationAlgorithm=NONE
```

### Why are the changes needed?

Keep Netty Java options sync everywhere.

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Pass GHA.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes apache#54209 from pan3793/SPARK-55428.

Authored-by: Cheng Pan <chengpan@apache.org>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants