Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

perf(kuma-cp): static data source loader #3903

Merged
merged 5 commits into from
Mar 2, 2022

Conversation

jakubdyszkiewicz
Copy link
Contributor

@jakubdyszkiewicz jakubdyszkiewicz commented Feb 22, 2022

Summary

Implement static data source loader. This is data source loader that relies on static list of secrets.
It's more performant in cases when we already retrieved secrets like in XDS generation.

This PR also deprecates file data source. It cannot be used with XDS generation since we don't follow changes of the file. It will be removed in the next major

Issues resolved

Fix #3893

Documentation

Testing

  • Unit tests
  • E2E tests
  • Manual testing on Universal
  • Manual testing on Kubernetes

Backwards compatibility

- [ ] Update UPGRADE.md with any steps users will need to take when upgrading.
- [ ] Add backport-to-stable label if the code follows our backporting policy

Signed-off-by: Jakub Dyszkiewicz <jakub.dyszkiewicz@gmail.com>
@jakubdyszkiewicz jakubdyszkiewicz requested a review from a team as a code owner February 22, 2022 11:13
…rce-loader

Signed-off-by: Jakub Dyszkiewicz <jakub.dyszkiewicz@gmail.com>
Signed-off-by: Jakub Dyszkiewicz <jakub.dyszkiewicz@gmail.com>
…rce-loader

Signed-off-by: Jakub Dyszkiewicz <jakub.dyszkiewicz@gmail.com>
Signed-off-by: Jakub Dyszkiewicz <jakub.dyszkiewicz@gmail.com>
@codecov-commenter
Copy link

Codecov Report

Merging #3903 (6836729) into master (63a3c0e) will increase coverage by 0.00%.
The diff coverage is 89.23%.

Impacted file tree graph

@@           Coverage Diff           @@
##           master    #3903   +/-   ##
=======================================
  Coverage   56.02%   56.02%           
=======================================
  Files         911      912    +1     
  Lines       54291    54318   +27     
=======================================
+ Hits        30414    30433   +19     
- Misses      21427    21434    +7     
- Partials     2450     2451    +1     
Impacted Files Coverage Δ
api/system/v1alpha1/datasource.pb.go 56.97% <ø> (ø)
pkg/api-server/inspect_endpoints.go 68.91% <ø> (+0.54%) ⬆️
pkg/xds/context/context.go 48.38% <ø> (ø)
pkg/xds/sync/egress_proxy_builder.go 0.00% <0.00%> (ø)
pkg/core/datasource/dynamic.go 85.18% <85.18%> (ø)
pkg/core/datasource/static.go 93.10% <93.10%> (ø)
pkg/xds/context/mesh_context_builder.go 68.00% <100.00%> (+0.21%) ⬆️
pkg/xds/context/resources.go 95.65% <100.00%> (+0.19%) ⬆️
pkg/xds/sync/components.go 100.00% <100.00%> (ø)
pkg/xds/sync/dataplane_proxy_builder.go 66.66% <100.00%> (+0.43%) ⬆️
... and 4 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 63a3c0e...6836729. Read the comment docs.

@jakubdyszkiewicz jakubdyszkiewicz merged commit a6ff939 into master Mar 2, 2022
@jakubdyszkiewicz jakubdyszkiewicz deleted the perf/static-datasource-loader branch March 2, 2022 15:33
michaelbeaumont added a commit to michaelbeaumont/kuma that referenced this pull request Mar 3, 2022
See kumahq#3903

Signed-off-by: Mike Beaumont <mjboamail@gmail.com>
michaelbeaumont added a commit to michaelbeaumont/kuma that referenced this pull request Mar 3, 2022
See kumahq#3903

Signed-off-by: Mike Beaumont <mjboamail@gmail.com>
michaelbeaumont added a commit that referenced this pull request Mar 3, 2022
See #3903

Signed-off-by: Mike Beaumont <mjboamail@gmail.com>
SallyBlichWalkMe pushed a commit to SallyBlichWalkMe/kuma that referenced this pull request Apr 14, 2022
Signed-off-by: Jakub Dyszkiewicz <jakub.dyszkiewicz@gmail.com>
Signed-off-by: Sally Blich <sally.blich@walkme.com>
SallyBlichWalkMe pushed a commit to SallyBlichWalkMe/kuma that referenced this pull request Apr 14, 2022
See kumahq#3903

Signed-off-by: Mike Beaumont <mjboamail@gmail.com>
Signed-off-by: Sally Blich <sally.blich@walkme.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Static DataSourceLoader
3 participants