-
Notifications
You must be signed in to change notification settings - Fork 378
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Showing
1 changed file
with
12 additions
and
13 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,35 +1,34 @@ | ||
Roadmap | ||
======= | ||
|
||
Version 0.7: Improved Ingredients | ||
--------------------------------- | ||
Improved Ingredients | ||
-------------------- | ||
|
||
- add a way for ingredients to modify the root config | ||
- add a pre-run hook | ||
- add a post-run hook | ||
- ship an ingredient that integrates with a hyperparameter optimization tool | ||
- ship an ingredient that allows for interactivity in the experiment | ||
- improve the ingredient example and test it | ||
- better documentation of ingredients | ||
|
||
|
||
Version 0.8: Simplify Reproduction | ||
---------------------------------- | ||
Run from Database | ||
----------------- | ||
|
||
Provide a means of re-running experiment directly from the database | ||
Provide a means of running experiment directly from the database. | ||
It should download the sources and resources and run the experiment with | ||
the config from the DB. This would make reproducing experiments extremely | ||
easy. | ||
the config from the DB. | ||
Together with the queue-option this would allow to use Sacred for managing runs | ||
in a distributed fashion. | ||
Also, this would make reproducing experiments extremely easy. | ||
|
||
|
||
|
||
Other ideas | ||
Other Ideas | ||
----------- | ||
|
||
- use Sacred with non-python experiments by making the python part a thin | ||
wrapper around the external program, but add tools to make them interact | ||
nicely. | ||
- a config-file in the home directory that configures some behaviours of | ||
Sacred globally, like log-level, observers to always add, ... | ||
- A flat file observer that produces html reports of the run | ||
- allow adding custom flags to the command-line interface | ||
- provide a unified interface to query the observers akin to the TinyDBReader | ||
- provide tools to generate reports, overview tables and plots. |