Declarative deployment

[nazar-pc]

Currently we deploy things imperatively: running scripts that modify state such that it takes desired shape. This works, but it is problematic because we can't revert changes, can't ensure state is exactly what we expect it to be and use tools designed for infrastructure creation to do so.

What we want instead is declarative deployments:

• Likely some kind of template, in case of k8s it would be Helm chart with some variables
• Then instantiation of the template with variables filled in, environment variables and secrets configured in it
• When developer wants to instantiate something, they just send a pull request, when pull request is merged, something like Argo CD will apply necessary changes to make sure deployment matches what was defined in the repository exactly
• Destruction then is as simple as reverting a pull request

For this to work we need to pick a tool for declarative deployment, key storage solution and have some templates (ideally with readme) that the rest of the team can work with somewhat autonomously.

Tasks

Beta Give feedback

1. Add ArgoCD manager to kubernetes
2. setup argo cd in cluster
3. create helm charts for astral and nova
4. create kustomize manifests for networks
5. update helm charts for squids rewards, account, general
6. create argocd path for declarative deployments of resources

[DaMandal0rian]

#143 adds argocd manager to kubernetes cluster as an addon with terraform

[DaMandal0rian]

argocd now installed in cluster

[DaMandal0rian]

Added devnet k8s deployments:

• declarative devnet deployments with kubernetes PT.1 #307
• declarative devnet deployments with kubernetes PT.2 #308
• declarative devnet deployments with kubernetes PT.3 #309

[DaMandal0rian]

Added squid deployments for k8s:

• add micro squid helm chart #304
• add account squid helm chart #305
• add general squid helm chart #306

[DaMandal0rian]

Next agenda:

• Now i need to test these deployments in the cluster and connect it to argocd to manage the deployments when change is made to the path it tracks.
• Need to add secrets configs since sensitive info can't be used in configmaps, will look at how to have this injected from Vault. Likely solution i will use is https://github.com/kubernetes-sigs/secrets-store-csi-driver which gets the secrets from vault and mounts it as a CSI volume.
• Then i will add the secrets config to the statefulset manifests

[DaMandal0rian]

Latest fix for domain validation and argocd environments.
https://github.com/subspace/infra/pull/315/files