Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a benchmarking notebook template #176

Closed
HealthyPear opened this issue Mar 10, 2022 · 0 comments · Fixed by #181
Closed

Add a benchmarking notebook template #176

HealthyPear opened this issue Mar 10, 2022 · 0 comments · Fixed by #181

Comments

@HealthyPear
Copy link
Member

There are now many more benchmarking notebooks.
I tried to uniformize them during their development (also because now the new protopipe-BENCHMARK script requires them to behave and interface with the benchmarks.yaml configuration file in the same way).

Nonetheless, some of them still have some slight differences and possible small bugs (see e.g. #173).
This effort should also take into account more and more refactoring of code from the notebooks to the "new" API under protopipe.benchmarks.
Being this a long work, it cannot be tight to the release of v0.5.0...

The repository should provide a template notebook to avoid new notebooks to diverge from the expected behavior and also to ease the update/fixes of existing notebooks.

@HealthyPear HealthyPear added this to To do in Pipeline features and enhancements via automation Mar 25, 2022
@HealthyPear HealthyPear added this to the v0.5.0 milestone Mar 25, 2022
@HealthyPear HealthyPear linked a pull request Mar 25, 2022 that will close this issue
Pipeline features and enhancements automation moved this from To do to Done Apr 4, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Development

Successfully merging a pull request may close this issue.

1 participant