Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

reproducibility improvement #30

Merged
merged 3 commits into from
Jun 27, 2024
Merged

Conversation

parmentelat
Copy link
Contributor

the point here is twofold:

  • superficially improved the readme about estimated measurements
  • refactor the reproducing notebook; that first version was a little rough, and needed to be made more user-friendly:
    • more consistent workflow
    • more command-line options -g (gpu only) -s (fast runs only) -d (dry-run)
    • interruptible with Control-C

more options available from the command line
more consistent way to implement the various filtering stages
this way we can go for more and more complex scenarios
also the shortcut for --dry-run becomes more traditional -n
@Sm00thix Sm00thix merged commit d2cdde5 into Sm00thix:benchmark Jun 27, 2024
1 check passed
Sm00thix added a commit that referenced this pull request Jun 27, 2024
* Added support for estimation of benchmarking for sk, np1, and np2. Also modified paper/README.md to clarify the estimation process. Also updated the notebook to reflect the newly added --estimate flag in time_pls.py. This is related to #24

* reproducibility improvement (#30)

* clarify the estimation methods

* refactor the notebook for reproducing results

more options available from the command line
more consistent way to implement the various filtering stages

* reproducing notebook: replace -s (bool) with -s <n>

this way we can go for more and more complex scenarios
also the shortcut for --dry-run becomes more traditional -n

* Clarified instructions for manual benchmarking in paper/README.md. Related to #24

---------

Co-authored-by: parmentelat <thierry.parmentelat@inria.fr>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants