[Epic] Core Functionality Enhancements

[rquitales]

Usage of the Pulumi Kubernetes Operator (PKO) has high friction due to a number of challenges for users. There are numerous performance enhancements that could be adopted by PKO, metrics and logging can sometimes be lacking as well as multi-tenancy concerns. We believe that targeted investments in this project can improve the user experience for users materially. By strengthening our core functionality, we can confidently embark on more ambitious innovations within PKO in the future.

Effort: 5 eng weeks
Goal/Impact: Reduced node CPU usage by at least 20% by allowing horizontal scaling; multi-tenancy support for a single operator installations; exposure of additional metrics to enable users to confidently deploy and debug PKO installations

Tasks

Beta Give feedback

1. Add metrics for currently reconciling stacks #576
   good-first-issue impact/usability kind/enhancement size/S +4
2. Push flux events when using a flux source #573
   area/flux kind/enhancement +2
3. Improve architecture for horizontal scaling #515
   kind/enhancement +1
4. Multi-tenancy considerations #501
   impact/security kind/enhancement +2
5. Move the reconciliation loop to a model where each run executes as a k8s Job #78
   kind/enhancement +1
6. Add resource requests/limits for controller pods #498
   good-first-issue kind/enhancement +2
7. Growing /tmp directory #564
   impact/performance kind/enhancement +2
8. npm install runs all the time #549
   kind/bug +1
9. Reduce the frequency at which the Pulumi Operator hits the GitHub API #461
   customer/feedback good-first-issue help-wanted impact/usability kind/enhancement size/S +6
10. Consider building separate containers for each runtime #451
    area/cicd customer/feedback kind/enhancement size/M +4
11. Provide ability to preserve working directory. #521
    impact/performance kind/enhancement +2
12. Improve testing by enabling unit and integration tests #447
    good-first-issue impact/reliability kind/enhancement +3