Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Better tracking of benchmark performances #112

Closed
registerrier opened this issue Sep 20, 2021 · 0 comments · Fixed by #138
Closed

Better tracking of benchmark performances #112

registerrier opened this issue Sep 20, 2021 · 0 comments · Fixed by #138

Comments

@registerrier
Copy link
Contributor

The current output of benchmarks allows to follow to total time and memory usage over time, but does not really indicate the evolution of sub-part of the benchmark scripts.
In some cases, this might completely hide some trend. For instance, the spectrum_1d CPU time is dominated by the data reduction step, but the fit or flux points parts can evolve very significantly.

We need a system able to track the various sub-tasks independently and able to provide a easy reading of results.

Additionally we might want to add some profiling information in order to better track performances degradations.

We have discussed using asv in the past. We might reconsider it.

@QRemy has already tested some profiling solutions and might want to comment. Opinions @adonath , @Bultako , @bkhelifi ?

@QRemy QRemy linked a pull request Mar 22, 2023 that will close this issue
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant