Safe exploration in Markov Decision Processes
Python Shell
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
doc
examples
safemdp
.coveragerc
.gitignore
.travis.yml
LICENSE
README.md
requirements.txt
setup.py
test_code.sh

README.md

SafeMDP

Build Status Documentation Status

Code for safe exploration in Markov Decision Processes (MDPs). This code accompanies the paper

M. Turchetta, F. Berkenkamp, A. Krause, "Safe Exploration in Finite Markov Decision Processes with Gaussian Processes", Proc. of the Conference on Neural Information Processing Systems (NIPS), 2016, [PDF]

Installation

The easiest way to install use the library is to install the Anaconda Python distribution. Then, run the following commands in the root directory of this repository:

pip install GPy
python setup.py install

Usage

The documentation of the library is available on Read the Docs

The file examples/sample.py implements a simple examples that samples a random world from a Gaussian process and shows exploration results.

The code for the experiments in the paper can be found in the examples/mars/ directory.