Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Manual] Deploy cluster components in development environment #3

Closed
8 of 9 tasks
nikimanoledaki opened this issue Oct 23, 2023 · 8 comments
Closed
8 of 9 tasks

Comments

@nikimanoledaki
Copy link
Contributor

nikimanoledaki commented Oct 23, 2023

This is to create a dev environment for the Green Reviews WG.

Cluster Creation

  • Create dev cluster
  • Share kubeconfig with other WG contributors to reuse the same clusters --> ping @rossf7 for kubeconfig

Cluster Components

Manage cluster components:

Phase 1: Base-level cluster components (MVP)

  • Cilium
  • Kepler
  • Prometheus

Phase 2: Gather idle metrics for Falco

  • Falco

Note: Falco can be deployed by the WG contributors in this dev environment to ensure that it can run alongside Kepler without any issues. However, we aim to extract this so that CNCF Project maintainers are responsible for configuring the deployment of the CNCF Project itself.

Phase 3: Gather load-test metrics

  • Synthetic workload
  • Load generation tool e.g. k6

Documentation

  • Document this process on the green-reviews-tooling repository & the design doc
@rossf7
Copy link
Contributor

rossf7 commented Oct 23, 2023

Adding myself

@AntonioDiTuri
Copy link
Contributor

I am also up for this 👍🏽

@nikimanoledaki nikimanoledaki changed the title Manually deploy Falco & Kepler on Equinix infra Manually deploy Falco & Kepler on Equinix infra for dev Oct 27, 2023
@nikimanoledaki nikimanoledaki changed the title Manually deploy Falco & Kepler on Equinix infra for dev Manually deploy cluster components on Equinix infra for dev testing Oct 31, 2023
@AntonioDiTuri
Copy link
Contributor

I have a question here: can we involve the Falco guys to get Falco deployed manually in the cluster as a first step? We could just give them the kubeconfig and get started while we think more about the pipeline approach. What do you think?

@rossf7
Copy link
Contributor

rossf7 commented Nov 3, 2023

Could we start by asking the Falco team how they would recommend we do the install? Maybe we can install it rather than giving access to the cluster?

@nikimanoledaki
Copy link
Contributor Author

nikimanoledaki commented Nov 22, 2023

Falco maintainers are in the process of creating a new repository (https://github.com/falcosecurity/cncf-green-review-testing) that will store everything needed from their side e.g. Falco deployment manifests, synthetic workload deployment manifests, benchmark tests, etc. However, Falco maintainers have less availability until early December.

It would be better to go with a workaround until then!

@nikimanoledaki
Copy link
Contributor Author

nikimanoledaki commented Nov 22, 2023

@nikimanoledaki nikimanoledaki changed the title Manually deploy cluster components on Equinix infra for dev testing [Manual Testing] Manually deploy cluster components on Equinix infra for dev testing Dec 11, 2023
@nikimanoledaki nikimanoledaki changed the title [Manual Testing] Manually deploy cluster components on Equinix infra for dev testing [Manual] Manually deploy cluster components on Equinix infra for dev testing Dec 11, 2023
@nikimanoledaki nikimanoledaki changed the title [Manual] Manually deploy cluster components on Equinix infra for dev testing [Manual] Deploy cluster components in development environment Dec 11, 2023
@AntonioDiTuri
Copy link
Contributor

Synthetic workload has been installed we choose https://github.com/GoogleCloudPlatform/microservices-demo/tree/main/helm-chart#readme and we install it manually via helm, here there is a pull request for the 2-lines documentation on how to reproduce it

@AntonioDiTuri
Copy link
Contributor

I think we can close this issue, we have developed manually almost everything except from Falco

rossf7 added a commit that referenced this issue Jan 23, 2024
Signed-off-by: Ross Fairbanks <ross@rossfairbanks.com>
Signed-off-by: Dipankar Das <dipankardas0115@gmail.com>

* Provision cluster with OpenTofu

Signed-off-by: Ross Fairbanks <ross@rossfairbanks.com>

* feat: Remove ansible and add worker node

Signed-off-by: Ross Fairbanks <ross@rossfairbanks.com>

* fix: Add -enable to tofu init

Signed-off-by: Ross Fairbanks <ross@rossfairbanks.com>

* fix: User data

* first iteration adding k3s for k8s clusters bootstrap

todo: need to test the script

Signed-off-by: Dipankar Das <dipankardas0115@gmail.com>

* comment to point out where is the kubeconfig

Signed-off-by: Dipankar Das <dipankardas0115@gmail.com>

* added var for k3s.version

Signed-off-by: Dipankar Das <dipankardas0115@gmail.com>

* removed deps for k3s agent token to use terraform/random

NOTE: value will be added via env vars

Signed-off-by: Dipankar Das <dipankardas0115@gmail.com>

---------

Signed-off-by: Ross Fairbanks <ross@rossfairbanks.com>
Signed-off-by: Dipankar Das <dipankardas0115@gmail.com>
Co-authored-by: Ross Fairbanks <ross@rossfairbanks.com>
Signed-off-by: Ross Fairbanks <ross@rossfairbanks.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants