[Request deployment] New Hub: Climatematch Academy

[colliand]

The GitHub handle of the community representative

@abodner

Hub important dates

Target start date: 2023-06-01
Target end date: 2023-08-31

Heavy usage will take place during the course. The course will run July 17-28 2023.

Hub Authentication Type

GitHub (e.g., @MyGitHubHandle)

First Hub Administrators

• @abodner
• @WesleyTheGeolien
• Who else? Abigail, please let us know whether other colleagues should be added in a comment below?

[GitHub Auth only] How would you like to manage your users?

Allowing members of specific GitHub team(s)

[GitHub Teams Auth only] Profile restriction based on team membership

pending

Abigail, can you please point to the GitHub team that Climatematch will use to manage user access to the hub?

Hub logo image URL

https://lh6.googleusercontent.com/pK1Zrf_NmWJ5KqhFB___4p8HPTf4D6u2om5UQkJbVQcwGjDSwlELPibkFfqW809chxybGrQwgiln8v0fRC00fYGzrsb6vIfFtsbh6PetpJKrk_UPoUb-4-RAH6ibtpXyxQ=w1280

Hub logo website URL

https://academy.climatematch.io/

Hub user image GitHub repository

pending, likely best to use latest pangeo image

Hub user image tag and name

pending; likely latest pangeo image

Extra features you would like to enable

• Dedicated Kubernetes cluster
• Scalable Dask Cluster

(Optional) Preferred cloud provider

AWS

(Optional) Billing and Cloud account

None

Other relevant information to the features above

Climatematch Academy will train a cohort of ~1000 students in computational methods for climate science. The academy is partly inspired by Pangeo and builds on a similar virtual school in Neuroscience created and operated by Neuromatch.

• shared cluster; cloud costs passed through by 2i2c/CS&S to be paid by Climatematch/Neuromatch
• for Pangeo style work? 2i2c can suggest best cloud vendor and data center; perhaps AWS us-west-2; or GCP?
• likely with a single hardware profile suitable for Pangeo-style student work; @abodner reports happiness using the small machine type deployed for M2Lines hub.
• suggested hub url: climatematch.2i2c.cloud with staging.climatematch.2i2c.cloud for companion staging hub. @abodner and team may redirect using DNS to point at hub.climatematch.io.

Tasks to deploy the hub

• 1. Deploy information filled in above
• 2. Engineer who will deploy the hub is assigned
• 3. If using GitHub Orgs/Teams Auth, Engineer is given Owner rights to the org to set this up.
• 4. Initial Hub deployment PR
• 5. Administrators able to log on -> Hub now in steady-state

[damianavila]

I have re-assigned this deployment to @yuvipanda. Yuvi, if you have any doubts about the details of this deployment, please ping @colliand for further details.

[WesleyTheGeolien]

Hey, Nice to meet you all finally (and virtually), I have seen your work in the past and I am a big fan you have done great things! Congrats! The GitHub team to use is: https://github.com/orgs/ClimateMatchAcademy/teams/2023students Is it possible to use 2 teams with different rights? Students we trust less but trust more teaching assistants: https://github.com/orgs/ClimateMatchAcademy/teams/2023teachingassistants I am unsure if we could / would allow different quotas based on the team a user is in? If this can not be done then please just use the students team. As for the Docker image. I will be building a new image based on the pang image, we have a few extra packages / pip installs of custom packages that need adding. I will get this done by Monday next week and will post you the image. I will have the docker file and I am thinking of pushing to docker hub (I know there is a quota for free accounts / orgs (100 or 200 pulls? From memory). Is there a different service you would need setup? I believe pangeo use Quay.io <http://quay.io/>? Yeah not quite sure what you need but I am sure I can provide either the image or docker file. Best regards, Weley Banfield

…

On 17 May 2023, at 11:49, Damian Avila ***@***.***> wrote: I have re-assigned this deployment to @yuvipanda <https://github.com/yuvipanda>. Yuvi, if you have any doubts about the details of this deployment, please ping @colliand <https://github.com/colliand> for further details. — Reply to this email directly, view it on GitHub <#2524 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AEJ3GYCZI3G3GUV7PJFXWTLXGSNJ5ANCNFSM6AAAAAAXU5ARXE>. You are receiving this because you were mentioned.

[yuvipanda]

Glad to work with you, @WesleyTheGeolien! Yes, we prefer you use quay.io rather than dockerhub! Let us know once the repo + image are setup :)

[WesleyTheGeolien]

Great,

Will do @yuvipanda,quick question will it always pull the latest? Eg. I post an image then realise I need some extra dependency so build and push a new image (potentially with some tag but the same tag I give you) will that auto update the hub (bearing in mind some time to propagate?)

In previous projects I have used watchtower I don't know if your setup uses something similar?

[yuvipanda]

@WesleyTheGeolien if your hub uses only one image, you will be able to self-configure it as an admin to pull whatever tag you want. We prefer to not use the 'latest' tag, but have the admins change tags when necessary via UI.

[yuvipanda]

And re: teams, let's just start with allowing access to the students team and see if that is enough?