Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Track Perf API performance with Bencher #367

Open
epompeii opened this issue Apr 16, 2024 · 0 comments
Open

Track Perf API performance with Bencher #367

epompeii opened this issue Apr 16, 2024 · 0 comments

Comments

@epompeii
Copy link
Member

epompeii commented Apr 16, 2024

Track the performance of the Bencher Perf API with Bencher.

I'm already dogfooding Bencher with Bencher, but all of the existing benchmark harness adapters are for micro-benchmarking harnesses. Most HTTP harnesses are really load testing harnesses, and load testing is different than benchmarking. Further, I'm not looking to expand Bencher into load testing anytime soon. That is a very different use case that would require very different design considerations.

Instead, implement a micro-benchmark that runs against the Perf API endpoint and dogfood the results with Bencher. This will require a sizable test database to make sure that performance regressions like #363 are caught in CI.

Read more: Why SQLite Performance Tuning made Bencher 1200x Faster

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant