Skip to content

perf: avoid redundant columnar shuffle when both parent and child are non-Comet #7483

perf: avoid redundant columnar shuffle when both parent and child are non-Comet

perf: avoid redundant columnar shuffle when both parent and child are non-Comet #7483

Triggered via pull request April 23, 2026 13:34
Status Cancelled
Total duration 8m 42s
Artifacts 5

pr_build_linux.yml

on: pull_request
Build Native Library
2m 39s
Build Native Library
ubuntu-latest/rust-test
4m 7s
ubuntu-latest/rust-test
Matrix: lint-java
Verify TPC-H Results
4m 15s
Verify TPC-H Results
Matrix: linux-test
Matrix: verify-benchmark-results-tpcds
Fit to window
Zoom out
Zoom in

Annotations

74 errors and 44 warnings
Spark 3.4, JDK 11, Scala 2.12/auto [shuffle]
Canceling since a higher priority waiting request for apache/datafusion-comet-avoid-jvm-shuffle-for-jvm-parent-PR Build (Linux) exists
Spark 3.4, JDK 11, Scala 2.12/auto [shuffle]
The operation was canceled.
Verify TPC-DS Results (sort_merge)
Canceling since a higher priority waiting request for apache/datafusion-comet-avoid-jvm-shuffle-for-jvm-parent-PR Build (Linux) exists
Verify TPC-DS Results (sort_merge)
The operation was canceled.
Spark 3.4, JDK 11, Scala 2.12/auto [csv]
Canceling since a higher priority waiting request for apache/datafusion-comet-avoid-jvm-shuffle-for-jvm-parent-PR Build (Linux) exists
Spark 3.4, JDK 11, Scala 2.12/auto [csv]
The operation was canceled.
Spark 3.4, JDK 11, Scala 2.12/auto [expressions]
Canceling since a higher priority waiting request for apache/datafusion-comet-avoid-jvm-shuffle-for-jvm-parent-PR Build (Linux) exists
Spark 3.4, JDK 11, Scala 2.12/auto [expressions]
The operation was canceled.
Spark 3.5.5, JDK 17, Scala 2.13/auto [csv]
Canceling since a higher priority waiting request for apache/datafusion-comet-avoid-jvm-shuffle-for-jvm-parent-PR Build (Linux) exists
Spark 3.5.5, JDK 17, Scala 2.13/auto [csv]
The operation was canceled.
Spark 3.4, JDK 11, Scala 2.12/auto [sql]
Canceling since a higher priority waiting request for apache/datafusion-comet-avoid-jvm-shuffle-for-jvm-parent-PR Build (Linux) exists
Spark 3.4, JDK 11, Scala 2.12/auto [sql]
The operation was canceled.
Spark 3.5.5, JDK 17, Scala 2.13/auto [sql]
Canceling since a higher priority waiting request for apache/datafusion-comet-avoid-jvm-shuffle-for-jvm-parent-PR Build (Linux) exists
Spark 3.5.5, JDK 17, Scala 2.13/auto [sql]
The operation was canceled.
Spark 3.5.5, JDK 17, Scala 2.13/auto [expressions]
Canceling since a higher priority waiting request for apache/datafusion-comet-avoid-jvm-shuffle-for-jvm-parent-PR Build (Linux) exists
Spark 3.5.5, JDK 17, Scala 2.13/auto [expressions]
The operation was canceled.
Spark 3.5.6, JDK 17, Scala 2.13/auto [parquet]
Canceling since a higher priority waiting request for apache/datafusion-comet-avoid-jvm-shuffle-for-jvm-parent-PR Build (Linux) exists
Spark 3.5.6, JDK 17, Scala 2.13/auto [parquet]
The operation was canceled.
Spark 3.5.6, JDK 17, Scala 2.13/auto [csv]
Canceling since a higher priority waiting request for apache/datafusion-comet-avoid-jvm-shuffle-for-jvm-parent-PR Build (Linux) exists
Spark 3.5, JDK 17, Scala 2.12/native_iceberg_compat [csv]
Canceling since a higher priority waiting request for apache/datafusion-comet-avoid-jvm-shuffle-for-jvm-parent-PR Build (Linux) exists
Spark 3.5, JDK 17, Scala 2.12/native_iceberg_compat [csv]
The operation was canceled.
Spark 4.0, JDK 17/auto [sql]
Canceling since a higher priority waiting request for apache/datafusion-comet-avoid-jvm-shuffle-for-jvm-parent-PR Build (Linux) exists
Spark 4.0, JDK 17/auto [sql]
The operation was canceled.
Verify TPC-H Results
Canceling since a higher priority waiting request for apache/datafusion-comet-avoid-jvm-shuffle-for-jvm-parent-PR Build (Linux) exists
Verify TPC-H Results
The operation was canceled.
Spark 3.4, JDK 11, Scala 2.12/auto [parquet]
Canceling since a higher priority waiting request for apache/datafusion-comet-avoid-jvm-shuffle-for-jvm-parent-PR Build (Linux) exists
Spark 3.4, JDK 11, Scala 2.12/auto [parquet]
The operation was canceled.
Spark 3.5.6, JDK 17, Scala 2.13/auto [fuzz]
Canceling since a higher priority waiting request for apache/datafusion-comet-avoid-jvm-shuffle-for-jvm-parent-PR Build (Linux) exists
Spark 3.5.6, JDK 17, Scala 2.13/auto [fuzz]
The operation was canceled.
Spark 3.4, JDK 11, Scala 2.12/auto [fuzz]
Canceling since a higher priority waiting request for apache/datafusion-comet-avoid-jvm-shuffle-for-jvm-parent-PR Build (Linux) exists
Spark 3.4, JDK 11, Scala 2.12/auto [fuzz]
The operation was canceled.
Verify TPC-DS Results (broadcast)
Canceling since a higher priority waiting request for apache/datafusion-comet-avoid-jvm-shuffle-for-jvm-parent-PR Build (Linux) exists
Verify TPC-DS Results (broadcast)
The operation was canceled.
Spark 3.5.5, JDK 17, Scala 2.13/auto [shuffle]
Canceling since a higher priority waiting request for apache/datafusion-comet-avoid-jvm-shuffle-for-jvm-parent-PR Build (Linux) exists
Spark 3.5.5, JDK 17, Scala 2.13/auto [shuffle]
The operation was canceled.
Spark 3.5, JDK 17, Scala 2.12/native_iceberg_compat [shuffle]
Canceling since a higher priority waiting request for apache/datafusion-comet-avoid-jvm-shuffle-for-jvm-parent-PR Build (Linux) exists
Spark 3.5, JDK 17, Scala 2.12/native_iceberg_compat [shuffle]
The operation was canceled.
Spark 3.5.6, JDK 17, Scala 2.13/auto [exec]
Canceling since a higher priority waiting request for apache/datafusion-comet-avoid-jvm-shuffle-for-jvm-parent-PR Build (Linux) exists
Spark 3.5.6, JDK 17, Scala 2.13/auto [exec]
The operation was canceled.
Spark 3.5, JDK 17, Scala 2.12/native_iceberg_compat [sql]
Canceling since a higher priority waiting request for apache/datafusion-comet-avoid-jvm-shuffle-for-jvm-parent-PR Build (Linux) exists
Spark 3.5.5, JDK 17, Scala 2.13/auto [fuzz]
Canceling since a higher priority waiting request for apache/datafusion-comet-avoid-jvm-shuffle-for-jvm-parent-PR Build (Linux) exists
Spark 3.5.5, JDK 17, Scala 2.13/auto [fuzz]
The operation was canceled.
Spark 3.5, JDK 17, Scala 2.12/native_iceberg_compat [fuzz]
Canceling since a higher priority waiting request for apache/datafusion-comet-avoid-jvm-shuffle-for-jvm-parent-PR Build (Linux) exists
Spark 3.5, JDK 17, Scala 2.12/native_iceberg_compat [fuzz]
The operation was canceled.
Verify TPC-DS Results (hash)
Canceling since a higher priority waiting request for apache/datafusion-comet-avoid-jvm-shuffle-for-jvm-parent-PR Build (Linux) exists
Verify TPC-DS Results (hash)
The operation was canceled.
Spark 3.5, JDK 17, Scala 2.12/native_iceberg_compat [parquet]
Canceling since a higher priority waiting request for apache/datafusion-comet-avoid-jvm-shuffle-for-jvm-parent-PR Build (Linux) exists
Spark 3.5, JDK 17, Scala 2.12/native_iceberg_compat [parquet]
The operation was canceled.
Spark 3.5.6, JDK 17, Scala 2.13/auto [shuffle]
Canceling since a higher priority waiting request for apache/datafusion-comet-avoid-jvm-shuffle-for-jvm-parent-PR Build (Linux) exists
Spark 3.5.6, JDK 17, Scala 2.13/auto [shuffle]
The operation was canceled.
Spark 3.5.6, JDK 17, Scala 2.13/auto [sql]
Canceling since a higher priority waiting request for apache/datafusion-comet-avoid-jvm-shuffle-for-jvm-parent-PR Build (Linux) exists
Spark 4.0, JDK 17/auto [shuffle]
Canceling since a higher priority waiting request for apache/datafusion-comet-avoid-jvm-shuffle-for-jvm-parent-PR Build (Linux) exists
Spark 4.0, JDK 17/auto [shuffle]
The operation was canceled.
Spark 3.5.6, JDK 17, Scala 2.13/auto [expressions]
Canceling since a higher priority waiting request for apache/datafusion-comet-avoid-jvm-shuffle-for-jvm-parent-PR Build (Linux) exists
Spark 3.5.6, JDK 17, Scala 2.13/auto [expressions]
The operation was canceled.
Spark 3.4, JDK 11, Scala 2.12/auto [exec]
Canceling since a higher priority waiting request for apache/datafusion-comet-avoid-jvm-shuffle-for-jvm-parent-PR Build (Linux) exists
Spark 3.4, JDK 11, Scala 2.12/auto [exec]
The operation was canceled.
Spark 4.0, JDK 17/auto [expressions]
Canceling since a higher priority waiting request for apache/datafusion-comet-avoid-jvm-shuffle-for-jvm-parent-PR Build (Linux) exists
Spark 4.0, JDK 17/auto [expressions]
The operation was canceled.
Spark 3.5.5, JDK 17, Scala 2.13/auto [parquet]
Canceling since a higher priority waiting request for apache/datafusion-comet-avoid-jvm-shuffle-for-jvm-parent-PR Build (Linux) exists
Spark 3.5.5, JDK 17, Scala 2.13/auto [parquet]
The operation was canceled.
Spark 3.5, JDK 17, Scala 2.12/native_iceberg_compat [exec]
Canceling since a higher priority waiting request for apache/datafusion-comet-avoid-jvm-shuffle-for-jvm-parent-PR Build (Linux) exists
Spark 3.5, JDK 17, Scala 2.12/native_iceberg_compat [exec]
The operation was canceled.
Spark 4.0, JDK 17/auto [fuzz]
Canceling since a higher priority waiting request for apache/datafusion-comet-avoid-jvm-shuffle-for-jvm-parent-PR Build (Linux) exists
Spark 4.0, JDK 17/auto [fuzz]
The operation was canceled.
Spark 4.0, JDK 17/auto [parquet]
Canceling since a higher priority waiting request for apache/datafusion-comet-avoid-jvm-shuffle-for-jvm-parent-PR Build (Linux) exists
Spark 4.0, JDK 17/auto [parquet]
The operation was canceled.
Spark 3.5, JDK 17, Scala 2.12/native_iceberg_compat [expressions]
Canceling since a higher priority waiting request for apache/datafusion-comet-avoid-jvm-shuffle-for-jvm-parent-PR Build (Linux) exists
Spark 3.5, JDK 17, Scala 2.12/native_iceberg_compat [expressions]
The operation was canceled.
Spark 3.5.5, JDK 17, Scala 2.13/auto [exec]
Canceling since a higher priority waiting request for apache/datafusion-comet-avoid-jvm-shuffle-for-jvm-parent-PR Build (Linux) exists
Spark 3.5.5, JDK 17, Scala 2.13/auto [exec]
The operation was canceled.
PR Build (Linux)
Canceling since a higher priority waiting request for apache/datafusion-comet-avoid-jvm-shuffle-for-jvm-parent-PR Build (Linux) exists
Spark 4.0, JDK 17/auto [exec]
Canceling since a higher priority waiting request for apache/datafusion-comet-avoid-jvm-shuffle-for-jvm-parent-PR Build (Linux) exists
Spark 4.0, JDK 17/auto [exec]
The operation was canceled.
Build Native Library
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Lint Java (Spark 3.4, JDK 11, Scala 2.12)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Lint Java (Spark 3.5, JDK 17, Scala 2.12)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Lint Java (Spark 4.0, JDK 17)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
ubuntu-latest/rust-test
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/cache@v4, actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark 4.0, JDK 17/auto [csv]
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark 3.4, JDK 11, Scala 2.12/auto [shuffle]
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Verify TPC-DS Results (sort_merge)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark 3.4, JDK 11, Scala 2.12/auto [csv]
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark 3.4, JDK 11, Scala 2.12/auto [expressions]
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark 3.5.5, JDK 17, Scala 2.13/auto [csv]
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark 3.4, JDK 11, Scala 2.12/auto [sql]
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark 3.5.5, JDK 17, Scala 2.13/auto [sql]
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark 3.5.5, JDK 17, Scala 2.13/auto [expressions]
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark 3.5.6, JDK 17, Scala 2.13/auto [parquet]
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark 3.5.6, JDK 17, Scala 2.13/auto [csv]
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark 3.5, JDK 17, Scala 2.12/native_iceberg_compat [csv]
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark 4.0, JDK 17/auto [sql]
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Verify TPC-H Results
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark 3.4, JDK 11, Scala 2.12/auto [parquet]
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark 3.5.6, JDK 17, Scala 2.13/auto [fuzz]
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark 3.4, JDK 11, Scala 2.12/auto [fuzz]
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Verify TPC-DS Results (broadcast)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark 3.5.5, JDK 17, Scala 2.13/auto [shuffle]
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark 3.5, JDK 17, Scala 2.12/native_iceberg_compat [shuffle]
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark 3.5.6, JDK 17, Scala 2.13/auto [exec]
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark 3.5, JDK 17, Scala 2.12/native_iceberg_compat [sql]
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark 3.5.5, JDK 17, Scala 2.13/auto [fuzz]
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark 3.5, JDK 17, Scala 2.12/native_iceberg_compat [fuzz]
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Verify TPC-DS Results (hash)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark 3.5, JDK 17, Scala 2.12/native_iceberg_compat [parquet]
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark 3.5.6, JDK 17, Scala 2.13/auto [shuffle]
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark 3.5.6, JDK 17, Scala 2.13/auto [sql]
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark 4.0, JDK 17/auto [shuffle]
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark 3.5.6, JDK 17, Scala 2.13/auto [expressions]
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark 3.4, JDK 11, Scala 2.12/auto [exec]
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark 4.0, JDK 17/auto [expressions]
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark 3.5.5, JDK 17, Scala 2.13/auto [parquet]
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark 3.5, JDK 17, Scala 2.12/native_iceberg_compat [exec]
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark 4.0, JDK 17/auto [fuzz]
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark 4.0, JDK 17/auto [parquet]
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark 3.5, JDK 17, Scala 2.12/native_iceberg_compat [expressions]
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark 3.5.5, JDK 17, Scala 2.13/auto [exec]
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Spark 4.0, JDK 17/auto [exec]
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/

Artifacts

Produced during runtime
Name Size Digest
java-test-reports-Spark 3.5, JDK 17, Scala 2.12-sql-24838289766-7483-1-native_iceberg_compat
1.86 KB
sha256:b6292a0ca4beda5012ac634b27a831aedeb891c4f60f82a8b801a37c991caa0b
java-test-reports-Spark 3.5.6, JDK 17, Scala 2.13-csv-24838289766-7483-1-auto
1.86 KB
sha256:88c07d023411d641bb9446688261337d532e8f94bab2c4b6c7b245a60b07d03f
java-test-reports-Spark 3.5.6, JDK 17, Scala 2.13-sql-24838289766-7483-1-auto
1.86 KB
sha256:bcebb30375dfe1a1ee1d697a314c5a8999a7618ce54d47593139ff7d24f0543d
java-test-reports-Spark 4.0, JDK 17-csv-24838289766-7483-1-auto
1.86 KB
sha256:e1e75ba2ce11f8253fd74c7d0707cc43602fbbdbba1bde1bd7764c259efdfbb1
native-lib-linux Expired
54.3 MB
sha256:0765b413f089761eea52993c2e2d5f93a933153674e3dc51a6744671c9603e8a