Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Examples Directory #40

Merged
merged 37 commits into from
Sep 5, 2020
Merged

Add Examples Directory #40

merged 37 commits into from
Sep 5, 2020

Conversation

salvis2
Copy link
Member

@salvis2 salvis2 commented Sep 1, 2020

I've been doing a lot of work independent of the others on this repo and I think it's time to put it somewhere on the main branch of the repo. These are three example deployments I've done, and I'm making a new folder aws-examples/ to house them. Part of my thought process is in this issue: #39

Since these are in a different folder, it shouldn't interfere with anyone's configurations. Let me know if you have thoughts @yuvipanda @jaytmiller @super-cob .

yuvipanda and others added 25 commits February 12, 2020 08:33
We should limit configuration options to things we want users
to change.
Minimal policy set to configure eks cluster with terraform. Several options are presented with comments.
That should be done by hubploy
It should work either way, but I thought it would be cleaner if all 3 nodegroup weren't managed. I also get to enable the k8s node-role this way.
This is for the UW groups' AWS resources. We have deployed an autotagging stack from GorillaStack to help us with billing. These lines help make sure Terraform tags resources the same way so that it doesn't undo changed made by the autotagging infrastructure.
Nodes are now spun up with the correct labels and taints, allowing for both autoscaling to and from 0 and spot instance usage.
Needed both of these set in order for the autoscaler to properly discover autoscaling groups.
Note: need to restrict hub.resources.requests.memory to 0.75G, or at least less than 1G
Since I changed the autotagger to put values to the 'Owner' tag, I am making the same changes here.
For me, this is us-west-2a. Others using this infrastucture on their accounts may have different zones, which is fine. The important thing is that the core node will only ever be in one zone in case you need to replace it.


Undoing my work that now lives on other branches / will be integrated later.
@salvis2
Copy link
Member Author

salvis2 commented Sep 1, 2020

Sorry about the commit history, I hadn't worked on master in a while, so everything above the merge commit is just catching up with the work everyone else has done.

@salvis2 salvis2 marked this pull request as draft September 1, 2020 23:01
@salvis2 salvis2 marked this pull request as ready for review September 4, 2020 21:17
@salvis2
Copy link
Member Author

salvis2 commented Sep 4, 2020

I tested the minimal-deployment-tutorial folder's configuration today, so now all of the examples have been vetted for actually being able to launch. Couple more commits to push though.

@salvis2 salvis2 merged commit 148b8ac into pangeo-data:master Sep 5, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants