ezex (i.e. easy experiment) is a python package for managing experiment runs. It keeps all experiments in a single folder and provides routines for starting/aborting jobs on computing clusters with lsf or slurm schedulers.
ezex dashboard opens a new jupyter notebook browser tab which can be used to visualize the experiments (type Shift+Enter to execute a cell). If TensorFlow is installed, experiments can also be visualized in tensorboard by clicking on tensorboard and then on open. Currently only one experiment at a time can be visualized in tensorboard.
To show a graph for each experiment the dashboard looks for a serialized n by 2 numpy array named ezex.npy in each experiment folder, generated for example by np.save('ezex.npy', X).
ezex remote <host> <user> forwards an ezex dashboard from a remote machine. Both machines require ezex and password-free ssh has to be set up.
ezex run <path> <tag> runs script at <path> by copying the folder containing it to a unique experiment folder and then submitting a job to a scheduler (e.g. slurm) to execute the copy. The -l option executes the copy locally without submitting a job.
sudo pip install ezex
or
pip install ezex --user
In the second case it might be nessessary to add export PATH=$PATH:$HOME/.local/bin to ~/.bashrc. The experiment folder can be changed e.g. via ezex set -exfolder <path>.
If the dashboard throws a js-widgets error it might be nessessary to install and activate ipywidgets manually via:
pip install ipywidgets
jupyter nbextension enable --py widgetsnbextension