Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

eks-prow-build-cluster: GitOps proposal #5336

Merged

Conversation

pkprzekwas
Copy link
Contributor

@pkprzekwas pkprzekwas commented May 29, 2023

General Description

This PR presents working GitOps proposal for EKS prow build cluster. It's based on FluxCD. The motivation for choosing FluxCD: "it's simple and doesn't require configuring any GH tokens or webhooks". This is more or less what we are looking for as we don't expect any complex deployment workflows. We aim to enable maintainers to easily introduce changes to k8s resources running on EKS prow build cluster.

Presented solution has been running for the past couple of days on prow-canary-cluster.

Potential improvements

  • leverage metrics and create Grafana dashboard dedicated for FluxCD,
  • consider moving k8s manifests managed by GitOps to a dedicated repository (otherwise tracking history will be cumbersome)

Other stuff

Introducing image updater has been skipped as it requires write permissions to GH repository.

/ref #5170
/assign @xmudrii @hh

@k8s-ci-robot k8s-ci-robot added cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. approved Indicates a PR has been approved by an approver from all required OWNERS files. area/infra Infrastructure management, infrastructure design, code in infra/ area/infra/aws Issues or PRs related to Kubernetes AWS infrastructure sig/k8s-infra Categorizes an issue or PR as relevant to SIG K8s Infra. labels May 29, 2023
@k8s-ci-robot k8s-ci-robot added the size/XXL Denotes a PR that changes 1000+ lines, ignoring generated files. label May 29, 2023
@hh
Copy link
Member

hh commented May 30, 2023

Overall looks fairly clean. It's Similar to other approaches to using flux.

Copy link

@sbdtu5498 sbdtu5498 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me, haven't used flux in the past but seems looks very similar to how Argo CD does things.

infra/aws/terraform/prow-build-cluster/README.md Outdated Show resolved Hide resolved
@pkprzekwas pkprzekwas requested a review from sbdtu5498 May 31, 2023 11:19
Copy link

@sbdtu5498 sbdtu5498 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Everything looks good!

Copy link
Member

@xmudrii xmudrii left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall looks great! I have some comments that should be mostly nits.

infra/aws/terraform/prow-build-cluster/README.md Outdated Show resolved Hide resolved
infra/aws/terraform/prow-build-cluster/README.md Outdated Show resolved Hide resolved
infra/aws/terraform/prow-build-cluster/README.md Outdated Show resolved Hide resolved
infra/aws/terraform/prow-build-cluster/README.md Outdated Show resolved Hide resolved
@pkprzekwas pkprzekwas force-pushed the eks-prow-build-cluster-gitops branch from 1ea28cb to 406c547 Compare June 1, 2023 14:02
Copy link
Member

@xmudrii xmudrii left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some more, hopefully final, nits.

infra/aws/terraform/prow-build-cluster/Makefile Outdated Show resolved Hide resolved
infra/aws/terraform/prow-build-cluster/Makefile Outdated Show resolved Hide resolved
infra/aws/terraform/prow-build-cluster/Makefile Outdated Show resolved Hide resolved
infra/aws/terraform/prow-build-cluster/README.md Outdated Show resolved Hide resolved
infra/aws/terraform/prow-build-cluster/README.md Outdated Show resolved Hide resolved
infra/aws/terraform/prow-build-cluster/README.md Outdated Show resolved Hide resolved
infra/aws/terraform/prow-build-cluster/README.md Outdated Show resolved Hide resolved
@pkprzekwas pkprzekwas requested a review from xmudrii June 2, 2023 08:44
@pkprzekwas pkprzekwas requested a review from xmudrii June 2, 2023 09:55
@k8s-ci-robot k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Jun 2, 2023
@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: pkprzekwas, xmudrii

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@k8s-ci-robot k8s-ci-robot merged commit bb35c9d into kubernetes:main Jun 2, 2023
3 checks passed
@k8s-ci-robot k8s-ci-robot added this to the v1.28 milestone Jun 2, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. area/infra/aws Issues or PRs related to Kubernetes AWS infrastructure area/infra Infrastructure management, infrastructure design, code in infra/ cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. lgtm "Looks good to me", indicates that a PR is ready to be merged. sig/k8s-infra Categorizes an issue or PR as relevant to SIG K8s Infra. size/XXL Denotes a PR that changes 1000+ lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants