Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Provisioner] Fix open ports on Azure #2891

Merged
merged 3 commits into from
Dec 22, 2023
Merged

[Provisioner] Fix open ports on Azure #2891

merged 3 commits into from
Dec 22, 2023

Conversation

cblmemo
Copy link
Collaborator

@cblmemo cblmemo commented Dec 21, 2023

This PR fixes the bug when opening ports in Azure sometimes.

The problem is when SkyPilot created the security group, it didn’t wait for the group to be created; Instead, it just returned and continued to open ports. If the open ports (add security rule) are finished earlier than the security group creation (the creation consists of multiple phases), it might get overridden.

Tested (run the relevant ones):

  • Code formatting: bash format.sh
  • Any manual or new tests for this PR (please specify below)
    • sky launch --cloud azure --ports 8080 --cpus 2 'python -m http.server 8080' --detach-run and curl for 40 clusters
  • All smoke tests: pytest tests/test_smoke.py
  • Relevant individual smoke tests: pytest tests/test_smoke.py::test_fill_in_the_name
    • pytest tests/test_smoke.py::test_skyserve_azure_http
  • Backward compatibility tests: bash tests/backward_comaptibility_tests.sh

Copy link
Collaborator

@concretevitamin concretevitamin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Awesome @cblmemo. Quick look.

sky/skylet/providers/azure/config.py Outdated Show resolved Hide resolved
sky/skylet/providers/azure/config.py Show resolved Hide resolved
Copy link
Collaborator

@concretevitamin concretevitamin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. May want to run some skyserve smoke tests on azure (opens more ports).

sky/skylet/providers/azure/config.py Show resolved Hide resolved
sky/skylet/providers/azure/config.py Outdated Show resolved Hide resolved
@cblmemo
Copy link
Collaborator Author

cblmemo commented Dec 22, 2023

pytest tests/test_smoke.py::test_skyserve_azure_http passed. Merged to master 🫡

@cblmemo cblmemo merged commit a9c52e6 into master Dec 22, 2023
19 checks passed
@cblmemo cblmemo deleted the fix-az-port branch December 22, 2023 02:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants