Skip to content

feat(ci): Improve Gradle cache in CI #1928

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 6 commits into from
Jul 14, 2025
Merged

Conversation

adutra
Copy link
Contributor

@adutra adutra commented Jun 24, 2025

No description provided.

Copy link
Member

@snazy snazy left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

(Not a review, as it's a draft)
Thinking a bit ahead, the restored Gradle cache could also be used by the regtests and other workflows to speed those up.

description: 'Java version'
default: '21'
job-id:
description: 'Job name to prefer'
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nit: the description should actually be

Suggested change
description: 'Job name to prefer'
description: 'Job ID to prefer'

@adutra adutra marked this pull request as ready for review July 3, 2025 15:24
@@ -53,9 +61,40 @@ jobs:
:polaris-server:quarkusAppPartsBuild --rerun \
-Dquarkus.container-image.build=true

- name: Save partial Gradle build cache
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should only store the Gradle caches from gradle.yaml, not from other workflows.

It's doesn't make much sense either, because the cache contents are only read, but never modified.

# NOTE: the regression test runs with spark 3.5.5 and scala 2.12 in Java 17. We also have integration
# tests runs with the existing gradle.yml, which only runs on Java 21. Since spark Java compatibility
# for 3.5 is 8, 11, and 17, we should run spark client with those compatible java versions.
# TODO: add separate spark client CI and run with Java 8, 11 and 17.
- name: Regression Test
run: |
docker compose -f plugins/spark/v3.5/regtests/docker-compose.yml up --build --exit-code-from regtest

store-gradle-cache:
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same here, no need to store

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks like we're good if this one is not stored

Copy link
Member

@snazy snazy left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!
The changes LGTM!

@github-project-automation github-project-automation bot moved this from PRs In Progress to Ready to merge in Basic Kanban Board Jul 14, 2025
@adutra adutra merged commit ad77bd9 into apache:main Jul 14, 2025
12 checks passed
@github-project-automation github-project-automation bot moved this from Ready to merge to Done in Basic Kanban Board Jul 14, 2025
@adutra adutra deleted the gradle-cache branch July 14, 2025 09:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants