Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docker: improve Rust dependency caching in CI to avoid rebuilding #6169

Open
gustavovalverde opened this issue Feb 15, 2023 · 2 comments
Open
Assignees
Labels
A-devops Area: Pipelines, CI/CD and Dockerfiles C-design Category: Software design work C-enhancement Category: This is an improvement I-heavy Problems with excessive memory, disk, or CPU usage P-Medium ⚡ S-needs-triage Status: A bug report needs triage

Comments

@gustavovalverde
Copy link
Member

Motivation

When files are copied into the Dockerfile with the COPY command, the cache can get invalidated. We could improve this by using the --link option which creates more independent layers to avoid rebuilding when not needed

Specifications

Documentation: https://docs.docker.com/engine/reference/builder/#copy---link

@gustavovalverde gustavovalverde added C-design Category: Software design work A-devops Area: Pipelines, CI/CD and Dockerfiles C-enhancement Category: This is an improvement S-needs-triage Status: A bug report needs triage P-Low ❄️ I-heavy Problems with excessive memory, disk, or CPU usage labels Feb 15, 2023
@gustavovalverde gustavovalverde self-assigned this Feb 15, 2023
@gustavovalverde gustavovalverde changed the title docker: improve caching by using the --link option with COPY docker: improve Rust dependency caching in CI to avoid rebuilding Sep 11, 2023
@gustavovalverde
Copy link
Member Author

This has become a cost issue, so we should prioritize it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A-devops Area: Pipelines, CI/CD and Dockerfiles C-design Category: Software design work C-enhancement Category: This is an improvement I-heavy Problems with excessive memory, disk, or CPU usage P-Medium ⚡ S-needs-triage Status: A bug report needs triage
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants