Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add functionality to skip existing runs, plotting modes, some refactoring #1

Closed
wants to merge 28 commits into from
Closed

Add functionality to skip existing runs, plotting modes, some refactoring #1

wants to merge 28 commits into from

Conversation

f-dangel
Copy link

  • Adding parameter skip_if_exists to runner.run
    • Default value is set such that the current behavior is maintained
    • By setting to True, runs that already have a .json output file will not be executed again
  • Possible extensions
    • Make skip_if_exists arg-parsable

@f-dangel
Auto-formatting
f3de79b
@f-dangel
Add parameter skip_if_exists to skip training if run already exists
d6fe634
@f-dangel
Extract fallback methods for batch size and num_epochs
b07d513
@f-dangel
Extract filename method without date
1668d99
@f-dangel
Remove check whether directory exists
be2d8f2
@f-dangel
Return matching output files for more verbose feedback
4ce4f48
@f-dangel
Auto-formatting
bf96b26
@f-dangel
Remove plt.show()
ae4a3d3
@f-dangel
Auto-formatting
bdf9699
@f-dangel
Add 25 and 75 quantile
432314f
@f-dangel
Add option to use quantiles as shade in plot
3490b7c
@f-dangel
Rename quantile_25(75) -> lower(upper)_quartile
4d890a9
@f-dangel
Add median and plotting modes mean+std, median+quartiles
5d32215
@f-dangel
Raise exception for invalid parameter 'which'
9d7ea37
@f-dangel
Add which argument to plot_testset_performances
9bbad94
@f-dangel
Add exponentiated mean and std of logarithmic quantities
9f48840
@f-dangel
Fix computation of mean and std in log space
2847a19
@f-dangel
Add batch count for test problem
41bdf08
@f-dangel
Return forward_func without evaluating it
49bb694
@f-dangel
evaluate_forward_func as last argument
ff6529d
@f-dangel
Add min and max to statistics
b4ede73
@f-dangel
Refactor aggregation: Remove eval statements and allow custom metrics
34d6348
@f-dangel
Fix typo
539cf84
@f-dangel
Propagate custom_metrics to SettingAnalyzer
74ac60f
@f-dangel
Fill up custom metrics with NaN if run did not finish
2f00f10
@f-dangel
Revert "evaluate_forward_func as last argument"
ce4081c 
This reverts commit ff6529d.
@f-dangel
Copy link
Author

f-dangel commented Sep 18, 2019 •
edited

  • Adding median and quartiles in statistics and for plotting (e.g. for logarithmic plots)
  • Refactor aggregation of statisticst, remove calls of eval
  • Add counter to testproblem for checking the number of pulled batches
  • Get forward function without calling it

@f-dangel f-dangel changed the title Add functionality to skip existing runs Add functionality to skip existing runs, plotting modes, some refactoring Sep 18, 2019
@f-dangel
Copy link
Author

@abahde I will submit the features separately

@f-dangel f-dangel closed this Sep 20, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
1 participant
@f-dangel