Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Provisioner] Fix cache for internal file mounts #2715

Merged
merged 4 commits into from
Oct 28, 2023

Conversation

Michaelvll
Copy link
Collaborator

@Michaelvll Michaelvll commented Oct 17, 2023

Fixes #2714

We should not cache the internal file mounts based on the wheel hash, as the cloud credential can be changed, and the cache will cause the credentials on the remote VM failed to udpate.

On master

sky launch -c test-cloud-account --cpus 2
time sky launch -c test-cloud-account --cpus 2
28s

On the current PR

sky launch -c test-cloud-account --cpus 2
time sky launch -c test-cloud-account --cpus 2
28s

That said, this change will not affect the performance.

This PR fixes the following reproduction:

  1. sky spot launch --cloud aws echo hi with only AWS credentials setup
  2. sky spot launch --cloud gcp echo hi with GCP credential setup already

Tested (run the relevant ones):

  • Code formatting: bash format.sh
  • Any manual or new tests for this PR (please specify below)
  • All smoke tests: pytest tests/test_smoke.py
  • Relevant individual smoke tests: pytest tests/test_smoke.py::test_fill_in_the_name
  • Backward compatibility tests: bash tests/backward_comaptibility_tests.sh

@Michaelvll Michaelvll added this to the v0.4.1 milestone Oct 27, 2023
Copy link
Collaborator

@suquark suquark left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@Michaelvll Michaelvll merged commit 1ec056e into master Oct 28, 2023
18 checks passed
@Michaelvll Michaelvll deleted the cloud-credential-updates branch October 28, 2023 00:35
Michaelvll added a commit that referenced this pull request Oct 29, 2023
* [Provisioner] Fix cache for internal file mounts (#2715)

* Fix file mounts

* print out the skylet version for better debugging ability

* Add skypilot version

* 0.4.1 version/commit
Michaelvll added a commit that referenced this pull request Oct 29, 2023
* [Provisioner] Fix cache for internal file mounts (#2715)

* Fix file mounts

* print out the skylet version for better debugging ability

* Add skypilot version

* 0.4.1 version/commit
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Provisioner] Fail to update cloud credential on remote VM
2 participants