You can do simulations presented in the paper by downloading and executing all py source files. First, you need to install Python (Anaconda recommended) in your computer. Second, download all py files and copy them into the same folder. Third, run each tutorial source file (e.g., python tutorial1.py) per your convenience.
These package should be installed to use Markov-Learning
- numpy (http://www.numpy.org/)
- pandas (http://pandas.pydata.org/)
- statsmodels (http://www.statsmodels.org/stable/index.html)
- scipy (https://www.scipy.org/)