-
Notifications
You must be signed in to change notification settings - Fork 216
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
chore: compare micro benchmarks #762
chore: compare micro benchmarks #762
Conversation
|
CI should fail if the benchmarks show a performance degradation of greater than 1%
ddb8e2b
to
f4c3da7
Compare
benches/criterion_compare.rs
Outdated
} else { | ||
((new_value - old_value) / old_value) * 100.0 | ||
} | ||
} |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
move this file to /scripts
benches/json_to_md.rs
Outdated
std::process::exit(1); | ||
} | ||
} | ||
} |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
move this file to /scripts
.github/workflows/bot.yml
Outdated
- name: Start Nginx | ||
run: | | ||
sudo systemctl start nginx | ||
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Nginx changes here are not relevant
/tip 150$ |
🎉🎈 @alankritdabral has been awarded $150! 🎈🎊 |
Summary:
Compare Criterion benchmarks with the cache_benchmarks
Added instructions to compare the benchmarks locally
run:
rust-script benches/criterion_compare <benchmarks1.json> <benchmarks2.json> check
to check the degradation in benchmarksrust-script benches/criterion_compare <benchmarks1.json> <benchmarks2.json> table
to get the comparison tablerust-script benches/criterion_compare <benchmarks1.json> <benchmarks2.json>
to get the comparison table and then check the degradation.Issue Reference(s):
Fixes #... (Replace "..." with the issue number)
Build & Testing:
cargo test
successfully../lint.sh --mode=fix
to fix all linting issues raised by./lint.sh --mode=check
.Checklist: