Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Move GKE temporary directories to ephemeral storage #1677

Open
michaelkedar opened this issue Sep 29, 2023 · 0 comments
Open

Move GKE temporary directories to ephemeral storage #1677

michaelkedar opened this issue Sep 29, 2023 · 0 comments
Labels
infra infrastructure bugs/FRs worker Worker-related infrastructure

Comments

@michaelkedar
Copy link
Member

Currently, our worker/importer/exporter use the attached persistent SSDs to store temporary data such as git repositories, which can cause problems if the files are not deleted before the pod exits.

#1666 somewhat addressed this by deleting the tmp folder on startup, but we shouldn't actually be storing these files on the that SSD anyway.

We should add an ephemeral ssd to the worker nodes to use for the working directory & temp files.

@andrewpollock andrewpollock added infra infrastructure bugs/FRs worker Worker-related infrastructure labels Nov 20, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
infra infrastructure bugs/FRs worker Worker-related infrastructure
Projects
None yet
Development

No branches or pull requests

2 participants