Skip to content

Commit

Permalink
updated ROADMAP
Browse files Browse the repository at this point in the history
  • Loading branch information
Qwlouse committed Jan 4, 2017
1 parent c30a06a commit e288013
Showing 1 changed file with 12 additions and 13 deletions.
25 changes: 12 additions & 13 deletions ROADMAP.rst
Original file line number Diff line number Diff line change
@@ -1,35 +1,34 @@
Roadmap
=======

Version 0.7: Improved Ingredients
---------------------------------
Improved Ingredients
--------------------

- add a way for ingredients to modify the root config
- add a pre-run hook
- add a post-run hook
- ship an ingredient that integrates with a hyperparameter optimization tool
- ship an ingredient that allows for interactivity in the experiment
- improve the ingredient example and test it
- better documentation of ingredients


Version 0.8: Simplify Reproduction
----------------------------------
Run from Database
-----------------

Provide a means of re-running experiment directly from the database
Provide a means of running experiment directly from the database.
It should download the sources and resources and run the experiment with
the config from the DB. This would make reproducing experiments extremely
easy.
the config from the DB.
Together with the queue-option this would allow to use Sacred for managing runs
in a distributed fashion.
Also, this would make reproducing experiments extremely easy.



Other ideas
Other Ideas
-----------

- use Sacred with non-python experiments by making the python part a thin
wrapper around the external program, but add tools to make them interact
nicely.
- a config-file in the home directory that configures some behaviours of
Sacred globally, like log-level, observers to always add, ...
- A flat file observer that produces html reports of the run
- allow adding custom flags to the command-line interface
- provide a unified interface to query the observers akin to the TinyDBReader
- provide tools to generate reports, overview tables and plots.

0 comments on commit e288013

Please sign in to comment.