-
Notifications
You must be signed in to change notification settings - Fork 29k
Add devicelab benchmark tags support #92141
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add devicelab benchmark tags support #92141
Conversation
/// "host_type": "linux", | ||
/// "host_version": "debian-10.11" | ||
/// } | ||
List<MetricPoint> parse(Map<String, dynamic> resultsJson, Map<String, dynamic> benchmarkTags) { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Would benchmark tags be synonymous with the BuildBucket build's properties?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
They are similar in denoting useful test related info, but the benchmark tags
here focus on benchmark related ones, especially the device and host info.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
How do we plan to generate these values? Is it a filtered set from the properties?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
It is not simply a subset of the properties, and the logic is not trivial.
I have a draft CL (WIP) to generate tags from recipes when running the tests.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks! That's what I was curious about
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Add benchmark tags support for devicelab benchmarks.
This will be a noop for existing workflow, unless we inject
tags
from recipe. A companion CL will be submitted soon.Related: #92203