A Library of MDP algorithms for Artificial Intelligence
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.



A Library of algorithms for planning using Markov Decision Procceses.

The library provides abstractions for representing MDPs and implementations of several popular MDP solvers, such as Value Iteration, LAO*, LRTDP and HDP. It also supports problems described in the PPDDL format. For these, a variety of determinization-based solvers are provided, such as FF-Replan, RFF and FF-LAO*.

The library has been tested in Ubuntu 12.04 and 14.04 (64-bit).

Some compilation notes

  • The PPDDL readed uses code from mini-gpt. To compile mini-gpt you will need the following dependencies:
    • yacc -- In Ubuntu you can run sudo apt-get install bison.
    • flex -- In Ubuntu you can run sudo apt-get install flex.