Build / Java21 (master, Scala 2.13, Hadoop 3, JDK 21) #1028
LuciferYangbuild_java21.yml
on: schedule
Run
/
Check changes
1m 47s
Run
/
Protobuf breaking change detection and Python CodeGen check
1m 15s
Run
/
Java 17 build with Maven
Run
/
Java 25 build with Maven
Run
/
Run TPC-DS queries with SF=1
1h 24m
Run
/
Run Docker integration tests
1h 22m
Run
/
Run Spark on Kubernetes Integration test
1h 9m
Run
/
Run Spark UI tests
43s
Matrix: Run / build
Run
/
Build modules: sparkr
25m 53s
Run
/
Linters, licenses, and dependencies
0s
Run
/
Documentation generation
0s
Matrix: Run / pyspark
Annotations
1 error and 8 warnings
|
Run / Build modules: pyspark-core, pyspark-errors, pyspark-streaming, pyspark-logger
/tmp/tmp.rg8b8bJWxC/lib/python3.11/site-packages/pyspark/jars/hadoop-client-api-3.4.3.jar
|
|
Run / Base image build
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: docker/build-push-action@v6, docker/login-action@v3, docker/setup-buildx-action@v3, docker/setup-qemu-action@v3. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Run / Build modules: sparkr
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@v2. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Run / Build modules: pyspark-core, pyspark-errors, pyspark-streaming, pyspark-logger
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@v2. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Run / Build modules: pyspark-structured-streaming, pyspark-structured-streaming-connect
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@v2. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Run / Build modules: pyspark-connect
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@v2. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Run / Build modules: pyspark-sql, pyspark-resource, pyspark-testing
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@v2. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Run / Build modules: pyspark-mllib, pyspark-ml, pyspark-ml-connect, pyspark-pipelines
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@v2. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Run / Run Docker integration tests
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: test-summary/action@v2. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
apache~spark~1A18TF.dockerbuild
|
29 KB |
sha256:6240190c8ee7f227c7b2aa3851436df52b2b605a77b4ab6e10d4314dae63fa11
|
|
|
apache~spark~YTYDS0.dockerbuild
|
33.3 KB |
sha256:ddd942d101abfe56e16638db098977d40befbc635f01050391f59d5ef9ef64c4
|
|
|
test-results-docker-integration--21-hadoop3-hive2.3
|
53.2 KB |
sha256:007e56ac478685197395dd0194e8f2f05c5e8e6734d8ada74f7d2c85d98ff48b
|
|
|
test-results-pyspark-connect--21-hadoop3-hive2.3-python3.11
|
202 KB |
sha256:b5d396b54f4911e6cbd21dadb39bdbb3de80e243701e8d33ed6a40a562a9d96d
|
|
|
test-results-pyspark-core, pyspark-errors, pyspark-streaming, pyspark-logger--21-hadoop3-hive2.3-python3.11
|
46.1 KB |
sha256:608b41ac2987299a3dd75e5926ff2c30343a6a547931398257474d0673ba4260
|
|
|
test-results-pyspark-mllib, pyspark-ml, pyspark-ml-connect, pyspark-pipelines--21-hadoop3-hive2.3-python3.11
|
101 KB |
sha256:397d8d6190c045b1ef0969746df83f16bdf08a5b168aa6042b50b50adc8ca18e
|
|
|
test-results-pyspark-sql, pyspark-resource, pyspark-testing--21-hadoop3-hive2.3-python3.11
|
204 KB |
sha256:1b171417997f98df613bda9d5a0975b93ce5cf4dfeed9ad986978dbd164350cb
|
|
|
test-results-pyspark-structured-streaming, pyspark-structured-streaming-connect--21-hadoop3-hive2.3-python3.11
|
31.1 KB |
sha256:0f8087e3ac5bcd515c5853aeb048d95f3acbd8a7274a5f3c8afa1dd177fa9a04
|
|
|
test-results-sparkr--21-hadoop3-hive2.3
|
17.1 KB |
sha256:b7355f70b5461b14d0bba62bb768abe71cd24e68254a7144aebfedd37aaa091a
|
|