Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactor CI to work on regular github runners + fix PLG support for K8s 1.25 #719

Merged
merged 28 commits into from
Sep 9, 2022

Conversation

jeff-mccoy
Copy link
Member

@jeff-mccoy jeff-mccoy commented Sep 7, 2022

Migrate back to regular-sized github runners.

  • Remove notification/helm controllers from flux example (cut CPU need in half)
  • Autoscale via kubectl coredns & zarf-agent to one pod
  • Reset zarf-registry CPU req to original 100m
  • Remove unnecessary build steps for requirements already present in the standard github runner
  • Updated PLG / disabled PSP to avoid breaking K8s 1.25+ (was breaking KinD on github runners)
  • Updated gitea
  • Re-added caching for go builds/modules (runners were taking > 5 mins to build the CLI without caching)
  • Added automatic logfile creation on zarf commands
  • Added runner artifact for downloading logfiles with complete debug info on pipeline runs

@jeff-mccoy jeff-mccoy force-pushed the i-hate-github-self-hosted-runners branch from c4ddfa3 to 4ac0dd6 Compare September 7, 2022 23:45
@jeff-mccoy jeff-mccoy force-pushed the i-hate-github-self-hosted-runners branch from 1dc3a43 to 0001b9d Compare September 8, 2022 21:21
@jeff-mccoy
Copy link
Member Author

Okay you can see the log multi write operations in CI now. CI will drop "debug-logs" artifact for each job that contains logs of all the runs with debug info included. The CI runner logs will not have debug info (unless explicitly set that way), but the logs written to disk will.

Screen Shot 2022-09-08 at 4 54 07 PM

Screen Shot 2022-09-08 at 4 50 19 PM

Screen Shot 2022-09-08 at 4 51 54 PM

Screen Shot 2022-09-08 at 4 51 18 PM

@jeff-mccoy jeff-mccoy changed the title I hate GitHub self hosted runners Refactor CI to work on regular github runners + fix PLG support for K8s 1.25 Sep 8, 2022
@jeff-mccoy jeff-mccoy marked this pull request as ready for review September 8, 2022 21:59
@jeff-mccoy jeff-mccoy enabled auto-merge (squash) September 9, 2022 07:40
.github/workflows/test-k3s.yml Outdated Show resolved Hide resolved
src/cmd/prepare.go Show resolved Hide resolved
Copy link
Contributor

@Racer159 Racer159 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@jeff-mccoy jeff-mccoy merged commit 0d2417a into master Sep 9, 2022
@jeff-mccoy jeff-mccoy deleted the i-hate-github-self-hosted-runners branch September 9, 2022 18:33
Noxsios pushed a commit that referenced this pull request Mar 8, 2023
…8s 1.25 (#719)

- Remove notification/helm controllers from flux example (cut CPU need in half)
- Autoscale via kubectl coredns & zarf-agent to one pod
- Reset zarf-registry CPU req to original 100m
- Remove unnecessary build steps for requirements already present in the standard github runner
- Updated PLG / disabled PSP to avoid breaking K8s 1.25+ (was breaking KinD on github runners)
- Updated gitea
- Re-added caching for go builds/modules (runners were taking > 5 mins to build the CLI without caching)
- Added automatic logfile creation on zarf commands
- Added runner artifact for downloading logfiles with complete debug info on pipeline runs
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants