Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use a single resource group for all Azure resources #146

Merged
merged 1 commit into from
Feb 22, 2022

Conversation

samkumar
Copy link
Contributor

@samkumar samkumar commented Feb 20, 2022

Fixes: #125

This pull request modifies Skylark's Azure support to use a single skylark resource group for all resources spawned for a transfer, across all Azure regions. Previously, Skylark would create a separate resource group for each VM and its associated resources (disk, NIC, public IP address, etc.). The motivation behind this change is to make Azure operations faster and more reliable, since we found that performing operations on resource groups can be quite slow.

@samkumar
Copy link
Contributor Author

Before merging this, we should make sure that this is actually faster/more reliable than the previous design, which had a resource group for each VM. I'll need to do some testing to be sure of this.

@samkumar samkumar force-pushed the feature-azure-resource-group branch 2 times, most recently from aa719f3 to 72c423b Compare February 20, 2022 21:20
@samkumar
Copy link
Contributor Author

I just added code to look for orphaned Azure resources and clean them up. Aside from perhaps additional testing, I think that this is ready.

Copy link
Contributor

@parasj parasj left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you Sam! LGTM.

@ShishirPatil
Copy link
Member

This seems to take slightly longer to provision. Is this expected?

Rest of it looks good to me!

@samkumar
Copy link
Contributor Author

@ShishirPatil The biggest thing is that I hoped it would be more reliable now, since we aren't creating/destroying resource groups all the time anymore. You were running into the reliability issues earlier, so you're in the best position to tell whether this resolves those issues...

Merging this now.

@samkumar samkumar merged commit 09f907b into main Feb 22, 2022
@samkumar samkumar deleted the feature-azure-resource-group branch February 22, 2022 05:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Azure resource groups
3 participants