Skip to content

[SPARK-XXXXX][PYTHON] Remove unnecessary .keys() in dict iterations #8030

[SPARK-XXXXX][PYTHON] Remove unnecessary .keys() in dict iterations

[SPARK-XXXXX][PYTHON] Remove unnecessary .keys() in dict iterations #8030

Triggered via push April 10, 2026 06:43
Status Cancelled
Total duration 1h 59m 37s
Artifacts 16

build_main.yml

on: push
Run  /  Protobuf breaking change detection and Python CodeGen check
1m 14s
Run / Protobuf breaking change detection and Python CodeGen check
Run  /  Java 17 build with Maven
45m 43s
Run / Java 17 build with Maven
Run  /  Java 25 build with Maven
40m 39s
Run / Java 25 build with Maven
Run  /  Run TPC-DS queries with SF=1
0s
Run / Run TPC-DS queries with SF=1
Run  /  Run Docker integration tests
0s
Run / Run Docker integration tests
Run  /  Run Spark on Kubernetes Integration test
0s
Run / Run Spark on Kubernetes Integration test
Run  /  Run Spark UI tests
37s
Run / Run Spark UI tests
Matrix: Run / build
Run  /  Build modules: sparkr
0s
Run / Build modules: sparkr
Run  /  Linters, licenses, and dependencies
20m 8s
Run / Linters, licenses, and dependencies
Run  /  Documentation generation
34m 48s
Run / Documentation generation
Matrix: Run / pyspark
Fit to window
Zoom out
Zoom in

Annotations

11 errors and 13 warnings
Run / Linters, licenses, and dependencies
Process completed with exit code 1.
Run / Build modules: pyspark-connect
Process completed with exit code 16.
Run / Build modules: pyspark-sql, pyspark-resource, pyspark-testing
Canceling since a higher priority waiting request for build-test-Build-refs/heads/py-clean-keys exists
Run / Build modules: pyspark-sql, pyspark-resource, pyspark-testing
The operation was canceled.
Run / Build modules: pyspark-pandas-slow-connect
Canceling since a higher priority waiting request for build-test-Build-refs/heads/py-clean-keys exists
Run / Build modules: pyspark-pandas-slow-connect
The operation was canceled.
Run / Build modules: pyspark-pandas-connect
Canceling since a higher priority waiting request for build-test-Build-refs/heads/py-clean-keys exists
Run / Build modules: pyspark-pandas-connect
The operation was canceled.
Run / Build modules: pyspark-pandas
Canceling since a higher priority waiting request for build-test-Build-refs/heads/py-clean-keys exists
Run / Build modules: pyspark-pandas
The operation was canceled.
Build
Canceling since a higher priority waiting request for build-test-Build-refs/heads/py-clean-keys exists
Run / Base image build
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: docker/build-push-action@10e90e3645eae34f1e60eeb005ba3a3d33f178e8, docker/login-action@c94ce9fb468520275223c153574b00df6fe4bcc9, docker/setup-buildx-action@8d2750c68a42422c14e847fe6c8ac0403b4cbd6f, docker/setup-qemu-action@29109295f81e9208d7d86ff1c6c12d2833863392. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Run / Protobuf breaking change detection and Python CodeGen check
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: bufbuild/buf-breaking-action@c57b3d842a5c3f3b454756ef65305a50a587c5ba, bufbuild/buf-lint-action@06f9dd823d873146471cfaaf108a993fe00e5325, bufbuild/buf-setup-action@a47c93e0b1648d5651a065437926377d060baa99. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Run / Build modules: pyspark-connect
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@31493c76ec9e7aa675f1585d3ed6f1da69269a86. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Run / Build modules: pyspark-connect
No files were found with the provided path: **/target/unit-tests.log. No artifacts will be uploaded.
Run / Build modules: pyspark-connect
No files were found with the provided path: **/target/test-reports/*.xml **/target/surefire-reports/*.xml. No artifacts will be uploaded.
Run / Build modules: pyspark-core, pyspark-errors, pyspark-streaming, pyspark-logger
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@31493c76ec9e7aa675f1585d3ed6f1da69269a86. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Run / Build modules: pyspark-structured-streaming, pyspark-structured-streaming-connect
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@31493c76ec9e7aa675f1585d3ed6f1da69269a86. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Run / Build modules: pyspark-mllib, pyspark-ml, pyspark-ml-connect, pyspark-pipelines
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@31493c76ec9e7aa675f1585d3ed6f1da69269a86. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Run / Build modules: pyspark-pandas-slow
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@31493c76ec9e7aa675f1585d3ed6f1da69269a86. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Run / Build modules: pyspark-sql, pyspark-resource, pyspark-testing
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@31493c76ec9e7aa675f1585d3ed6f1da69269a86. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Run / Build modules: pyspark-pandas-slow-connect
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@31493c76ec9e7aa675f1585d3ed6f1da69269a86. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Run / Build modules: pyspark-pandas-connect
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@31493c76ec9e7aa675f1585d3ed6f1da69269a86. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Run / Build modules: pyspark-pandas
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@31493c76ec9e7aa675f1585d3ed6f1da69269a86. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/

Artifacts

Produced during runtime
Name Size Digest
site Expired
64.2 MB
sha256:5abf6e17024af7aca721205b78d2ff2f386b1674a1bad44f1cfcf06077a9e161
test-results-pyspark-core, pyspark-errors, pyspark-streaming, pyspark-logger--17-hadoop3-hive2.3-python3.12
42.7 KB
sha256:ca03c86083f4a6dc643be7304c1d249751255bb2df122e80995ac15c5352ba53
test-results-pyspark-mllib, pyspark-ml, pyspark-ml-connect, pyspark-pipelines--17-hadoop3-hive2.3-python3.12
99.1 KB
sha256:ad1085ea3b51192482e1d5672520c4a54b134b208aa5fefbdde65d69b36383ce
test-results-pyspark-pandas--17-hadoop3-hive2.3-python3.12
120 KB
sha256:c514d0684225f2718b0e2848c469ecf5b6bdad2233aa9e0184dd3300a36c8fef
test-results-pyspark-pandas-connect--17-hadoop3-hive2.3-python3.12
121 KB
sha256:11f6c4af91aecf743a8637d5d24e871d9eba16614d5fc555d489d1726657372a
test-results-pyspark-pandas-slow--17-hadoop3-hive2.3-python3.12
108 KB
sha256:7a7d2963ed8f5617689385388ade36ba7cc246ae4eb5aea44c0022a33d028b46
test-results-pyspark-pandas-slow-connect--17-hadoop3-hive2.3-python3.12
81.7 KB
sha256:5619a6cf35982ad7db9857ee6214791703eb8d11fec5de9cf9dc905ca53c0cea
test-results-pyspark-sql, pyspark-resource, pyspark-testing--17-hadoop3-hive2.3-python3.12
205 KB
sha256:54d77c6c6c6c8627a4911f00af170816e315ad86720303edc53e8aba88facf5d
test-results-pyspark-structured-streaming, pyspark-structured-streaming-connect--17-hadoop3-hive2.3-python3.12
31.7 KB
sha256:4fcf32bffcbd3faea7d97c347784aad00b1b77f2ae460a240f1931c13416163a
unit-tests-log-pyspark-pandas--17-hadoop3-hive2.3-python3.12
3.79 MB
sha256:9f5dc5af29c08b0d949fdcd8a2930598adabcd22e24c486236bd320354fd870a
unit-tests-log-pyspark-pandas-connect--17-hadoop3-hive2.3-python3.12
7.57 MB
sha256:330d03e399cdd7716d2902b008613211e1d4fcae56d308cf634589ef98659b14
unit-tests-log-pyspark-pandas-slow-connect--17-hadoop3-hive2.3-python3.12
6.84 MB
sha256:81cb8882c74df752be999933dee99e8b30fdcca068d6a573869db96b6117fd15
unit-tests-log-pyspark-sql, pyspark-resource, pyspark-testing--17-hadoop3-hive2.3-python3.12
6.02 MB
sha256:fccafd2de9e60dd108613e4920fa2db10f638da37980c7fccafcc024623cfcc2
zhengruifeng~spark~3J8OXS.dockerbuild
24.4 KB
sha256:d40a75ee2c510940d110f1ff15f702c476e3cc48b2bc67375142d61dd9c8811d
zhengruifeng~spark~NRO87L.dockerbuild
28 KB
sha256:38b2f0a370466066d11e1f8b5bcf9e26fc499e77a48974417078d9cdaf2ee8c5
zhengruifeng~spark~QVV5B1.dockerbuild
31.4 KB
sha256:ee7cbb0720df4b502056e30865224094a35adbfc9149bd725531be890c742698