Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Explicitly list the tool used for running benchmarks #8179

Merged
merged 1 commit into from Jan 25, 2022
Merged

Explicitly list the tool used for running benchmarks #8179

merged 1 commit into from Jan 25, 2022

Conversation

antiagainst
Copy link
Contributor

This is a preliminary step to enable using other benchmark
tools to report other benchmarks like statistics.

@antiagainst
Explicitly list the tool used for running benchmarks
8c8680f 
This is a preliminary step to enable using other benchmark
tools to report other benchmarks like statistics.
@antiagainst antiagainst added platform/android 🤖 Android-specific build, execution, benchmarking, and deployment infrastructure/benchmark Relating to benchmarking infrastructure (deprecated) buildkite:benchmark-android Deprecated. Please use benchmarks:android-* labels Jan 25, 2022
@iree-github-actions-bot
Copy link
Contributor

Abbreviated Benchmark Summary

@ commit 8c8680fe0248a97611296d7210695cb643b0fa6c (vs. base fe15d40350dea1f6e8f7b71e762cd73fb91432e8)

Regressed Benchmarks 🚩

Benchmark Name Average Latency (ms) Median Latency (ms) Latency Standard Deviation (ms)
PoseNet [fp32] (TFLite) kernel-execution,experimental-flags with IREE-Vulkan @ Pixel-6-Pro (GPU-Mali-G78) 16 (vs. 15, 6.67%↑) 16 0

For more information:

@antiagainst antiagainst marked this pull request as ready for review January 25, 2022 17:30
@antiagainst antiagainst merged commit 9dc8160 into iree-org:main Jan 25, 2022
@antiagainst antiagainst deleted the benchmark-tool branch January 25, 2022 19:39
@GMNGeoffrey GMNGeoffrey added the infrastructure Relating to build systems, CI, or testing label Jul 19, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ScottTodd ScottTodd ScottTodd approved these changes

@GMNGeoffrey GMNGeoffrey Awaiting requested review from GMNGeoffrey

Assignees
No one assigned
Labels
(deprecated) buildkite:benchmark-android Deprecated. Please use benchmarks:android-* infrastructure/benchmark Relating to benchmarking infrastructure infrastructure Relating to build systems, CI, or testing platform/android 🤖 Android-specific build, execution, benchmarking, and deployment
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
4 participants
@antiagainst @iree-github-actions-bot @ScottTodd @GMNGeoffrey