Onboarding a "light" cluster

[larsks]

We've recently deployed an OCP 4.7 bare metal cluster for the Curator project. I'd like to manage some aspects of the cluster through this repository (e.g., the default ingress certificate, the connection with the SSO environment, etc), but there will be other cluster admins who will be "doing their own thing". The overlay configuration would be minimal, probably something like:

resources:
  - ../../../base/clusterrolebindings/cluster-admins-rb
  - ../../../base/groups/cluster-admins
  - ../../../base/ingresscontrollers/default
  - ../../../base/oauths/cluster
  - ../../../base/subscriptions/web-terminal

Does this seem like a reasonable plan?

[HumairAK]

This sounds reasonable to me -- did you want these resources managed by argocd as well? or just git tracked?

[larsks]

Oh, ideally using argocd.

[tumido]

Sounds good to me. If you want to manage it via argocd, I'd suggest to import it to our ACM which will take care of the ArgoCD setup

[HumairAK]

I'd suggest to import it to our ACM which will take care of the ArgoCD setup

@larsks let us know if this is something you'll be doing, otherwise we will need an SA sitting in this new cluster with cluster admin that argocd can use to login.

[larsks]

We installed it using ACM (https://multicloud-console.apps.moc-infra.massopen.cloud/multicloud/clusters/curator/overview), but if there's any specific metadata we need to set that says "we're going to manage this using argocd", we didn't set that.

[tumido]

Just update the KlusterletAddonConfig with:

spec:
  applicationManager:
    argocdCluster: true

And you're all set 👍

[tumido]

That reminds me, until ACM BZ 1939096 is resolved, we should probable reserve the namespaces which are created by ACM for the managed clusters in this repo so we don't accidentally touch it...

[tumido]

@larsks additionally to that you want to create a similar ArgoCD app for the curator:

https://github.com/operate-first/argocd-apps/blob/main/envs/moc/zero/cluster-management/cluster-resources.yaml

And create app of apps:
https://github.com/operate-first/continuous-deployment/blob/master/manifests/overlays/moc-infra/applications/app-of-apps-infra.yaml

@HumairAK I wonder, can we move the app of apps to the argocd-apps repo? So adding a cluster would be only PRs against 2 repos, instead of 3?