Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[T.3.1] Integrate Computational Notebooks with ReBenchDB #183

Open
smarr opened this issue Dec 4, 2021 · 0 comments
Open

[T.3.1] Integrate Computational Notebooks with ReBenchDB #183

smarr opened this issue Dec 4, 2021 · 0 comments
Labels
help-wanted We'd like help with this issue, and are happy to provide guidance Proposal Work proposed as part of a (rejected) funding application

Comments

@smarr
Copy link
Owner

smarr commented Dec 4, 2021

The goal is to have a somewhat common UI that enables easy reuse of analyses from previous projects, or experiments.

ReBenchDB will need an API to access data, as well as a library of analyses.
The API should be general enough to be used by other scripts as well.

Use cases we would want to support are:

  • basic analyses (speedups, overhead, scaling, performance regressions, ...)
  • correlating of data (different metrics, historical data, ...)

Other than Jupyter there might be other systems that could be appropriate:
https://www.samlau.me/pubs/computational-notebooks-design-space_VLHCC-2020.pdf

Ideally, the reports are easily versioned and reproducible.

Analyses, plots, and data processing code would idea be made available as a library of reusable notebook cells, that can be combined, adapted, and shared freely.

@smarr smarr added help-wanted We'd like help with this issue, and are happy to provide guidance Proposal Work proposed as part of a (rejected) funding application labels Dec 4, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
help-wanted We'd like help with this issue, and are happy to provide guidance Proposal Work proposed as part of a (rejected) funding application
Projects
Status: WP.3 Performance Analysis Notebooks and a Library of Building Blocks
Development

No branches or pull requests

1 participant