Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test(metrics): collect Firecracker vhost-user metrics #4246

Merged
merged 1 commit into from
Nov 29, 2023

Conversation

sudanl0
Copy link
Contributor

@sudanl0 sudanl0 commented Nov 17, 2023

Changes

Add a test to collect vhost-user metrics from Firecracker.

Reason

To monitor any regressions in vhost-user metrics over time.

License Acceptance

By submitting this pull request, I confirm that my contribution is made under
the terms of the Apache 2.0 license. For more information on following
Developer Certificate of Origin and signing off your commits, please check
CONTRIBUTING.md.

PR Checklist

  • [ ] If a specific issue led to this PR, this PR closes the issue.
  • The description of changes is clear and encompassing.
  • [ ] Any required documentation changes (code and docs) are included in this PR.
  • [ ] API changes follow the Runbook for Firecracker API changes.
  • ~~[ ] User-facing changes are mentioned in CHANGELOG.md.
  • All added/changed functionality is tested.
  • [ ] New TODOs link to an issue.
  • Commits meet contribution quality standards.

  • This functionality cannot be added in rust-vmm.

Copy link

codecov bot commented Nov 17, 2023

Codecov Report

All modified and coverable lines are covered by tests ✅

Comparison is base (3d18abc) 81.69% compared to head (6734242) 81.69%.

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #4246   +/-   ##
=======================================
  Coverage   81.69%   81.69%           
=======================================
  Files         240      240           
  Lines       29293    29293           
=======================================
  Hits        23932    23932           
  Misses       5361     5361           
Flag Coverage Δ
4.14-c7g.metal 77.15% <ø> (ø)
4.14-m5d.metal 79.04% <ø> (ø)
4.14-m6a.metal 78.16% <ø> (ø)
4.14-m6g.metal 77.15% <ø> (ø)
4.14-m6i.metal 79.03% <ø> (ø)
5.10-c7g.metal 80.03% <ø> (ø)
5.10-m5d.metal 81.69% <ø> (ø)
5.10-m6a.metal 80.90% <ø> (ø)
5.10-m6g.metal 80.03% <ø> (ø)
5.10-m6i.metal 81.68% <ø> (ø)
6.1-c7g.metal 80.03% <ø> (ø)
6.1-m5d.metal 81.68% <ø> (-0.02%) ⬇️
6.1-m6a.metal 80.90% <ø> (ø)
6.1-m6g.metal 80.03% <ø> (ø)
6.1-m6i.metal 81.68% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@sudanl0 sudanl0 force-pushed the vhost_user_ci_metrics branch 2 times, most recently from d60df85 to adab456 Compare November 17, 2023 13:57
@sudanl0
Copy link
Contributor Author

sudanl0 commented Nov 17, 2023

Blocked on #4223 to add 1 more metric

@sudanl0 sudanl0 self-assigned this Nov 17, 2023
@sudanl0 sudanl0 force-pushed the vhost_user_ci_metrics branch 2 times, most recently from 7f8df60 to b706244 Compare November 17, 2023 15:54
@sudanl0 sudanl0 force-pushed the vhost_user_ci_metrics branch 4 times, most recently from cb4b6a4 to db9904f Compare November 25, 2023 23:25
@sudanl0 sudanl0 marked this pull request as draft November 27, 2023 12:10
@sudanl0 sudanl0 force-pushed the vhost_user_ci_metrics branch 15 times, most recently from 5b8312d to 198b8d2 Compare November 27, 2023 20:54
@sudanl0 sudanl0 force-pushed the vhost_user_ci_metrics branch 6 times, most recently from 3bc2b44 to c0cc644 Compare November 29, 2023 10:08
@sudanl0 sudanl0 force-pushed the vhost_user_ci_metrics branch 6 times, most recently from 76db532 to 04aaec8 Compare November 29, 2023 11:21
@sudanl0 sudanl0 force-pushed the vhost_user_ci_metrics branch 3 times, most recently from c143302 to 651d4ce Compare November 29, 2023 15:12
Add a test to boot a VM with vhost-user as a scratch device.
Resize the vhost-user scratch drive to have config change notifications
and collect vhost-user metrics emitted by Firecracker for this test.
Export the metrics to CloudWatch.
We use a new file in performance directory for this test becuase:
1. Tests doesn't need to be ABfied so can't be part of test_block_ab
   and the Performance pipeline.
2. By running in nightly pipeline keeping the test in functional
   directory, there will be lot of other tests running in parallel
   resulting in noisy metrics.
3. Nightly pipeline runs performance tests in a decidated BK agent,
   with nothing else running on the host, and with no parallelism so
   it makes sense to move to performance directory but keep it out of
   AB tests.

Signed-off-by: Sudan Landge <sudanl@amazon.com>
@sudanl0 sudanl0 added the Status: Awaiting review Indicates that a pull request is ready to be reviewed label Nov 29, 2023
@sudanl0 sudanl0 merged commit cc8464e into firecracker-microvm:main Nov 29, 2023
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Status: Awaiting review Indicates that a pull request is ready to be reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants