Safe exploration in Markov Decision Processes
Python Shell
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Failed to load latest commit information.
doc Change docs fullname to name Oct 19, 2016
examples Update requirements.txt Aug 19, 2016
safemdp Readd deleted imports Nov 17, 2016


Build Status Documentation Status

Code for safe exploration in Markov Decision Processes (MDPs). This code accompanies the paper

M. Turchetta, F. Berkenkamp, A. Krause, "Safe Exploration in Finite Markov Decision Processes with Gaussian Processes", Proc. of the Conference on Neural Information Processing Systems (NIPS), 2016, [PDF]


The easiest way to install use the library is to install the Anaconda Python distribution. Then, run the following commands in the root directory of this repository:

pip install GPy
python install


The documentation of the library is available on Read the Docs

The file examples/ implements a simple examples that samples a random world from a Gaussian process and shows exploration results.

The code for the experiments in the paper can be found in the examples/mars/ directory.