Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make it easy to do multiple measurements on a given benchmark #179

Open
cdeil opened this issue Jan 7, 2015 · 2 comments
Open

Make it easy to do multiple measurements on a given benchmark #179

cdeil opened this issue Jan 7, 2015 · 2 comments
Labels
enhancement Triaged as an enhancement request

Comments

@cdeil
Copy link
Contributor

cdeil commented Jan 7, 2015

I've started to write benchmarks for Gammapy and decided that mostly high-level benchmarks running compute-heavy end-user analysis tasks are of interest and for each of those I'm interested in:

  • CPU time
  • Wall clock time
  • Memory use

@mdboom Would it make sense to implement a mechanism that makes it easy to do several benchmarks (namely the three I mentioned) without having to write boilerplate code? Maybe via a decorator listing which measurements I want?

@mdboom
Copy link
Collaborator

mdboom commented Jan 7, 2015

This is a good idea. I'll self-assign if I find some free time to work on it, otherwise all patches welcome!

@erwanp
Copy link
Contributor

erwanp commented Jun 16, 2021

I have a similar need : a single benchmark for the spectroscopy RADIS code can take up to 250s ; and computing it twice for PeakMemory and CPU-wall-time takes a lot of time.

Would it be possible and still accurate to measure both the PeakMemory and the CPU-wall-time on a single run ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement Triaged as an enhancement request
Projects
None yet
Development

No branches or pull requests

4 participants