Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BP-1.16][FLINK-32392][ci] Invalidate Maven repo cache on Azure every year to reduce its disk usage #22867

Merged
merged 1 commit into from
Jun 28, 2023

Conversation

PatrickRen
Copy link
Contributor

Unchanged back port of #22858 on release-1.16

@flinkbot
Copy link
Collaborator

flinkbot commented Jun 26, 2023

CI report:

Bot commands The @flinkbot bot supports the following commands:
  • @flinkbot run azure re-run the last Azure build

@snuyanzin
Copy link
Contributor

Since CI fails with

Jun 26 12:40:26 [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.22.1:test (end-to-end-tests) on project flink-end-to-end-tests-aws-kinesis-streams: Unable to generate classpath: org.apache.maven.artifact.resolver.ArtifactResolutionException: Failure to transfer org.opentest4j:opentest4j:jar:1.1.1 from https://maven-central-eu.storage-download.googleapis.com/maven2/ was cached in the local repository, resolution will not be reattempted until the update interval of google-maven-central has elapsed or updates are forced. Original error: Could not transfer artifact org.opentest4j:opentest4j:jar:1.1.1 from/to google-maven-central (https://maven-central-eu.storage-download.googleapis.com/maven2/): Entry [id:28][route:{s}->https://maven-central-eu.storage-download.googleapis.com:443][state:null/] has not been leased from this pool
Jun 26 12:40:26 [ERROR] org.opentest4j:opentest4j:jar:1.1.1

I wonder if there is a way to say -U for the case when it's the build with empty cache?

@PatrickRen
Copy link
Contributor Author

@snuyanzin I don't think adding -U could help, as the root cause is actually

Could not transfer artifact org.opentest4j:opentest4j:jar:1.1.1 from/to google-maven-central (https://maven-central-eu.storage-download.googleapis.com/maven2/): Entry [id:28][route:{s}->https://maven-central-eu.storage-download.googleapis.com:443][state:null/] has not been leased from this pool

which happened when downloading the dependency.

I found FLINK-16947, which shows the same error messages. Probably it's another bug in the HTTP client that Maven Wagon depends on 😞

@PatrickRen
Copy link
Contributor Author

@flinkbot run azure

@PatrickRen
Copy link
Contributor Author

I checked the log in the second CI run, and there is cache hit already. I'm gonna merge it as this instability should be very rare and higher Maven version on master branch has already fixed it.

@PatrickRen PatrickRen merged commit 020990a into apache:release-1.16 Jun 28, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants