Skip to content

WenjieZ/NARS

Repository files navigation

NARS: Not A Replication of Sutton

This project is not a mere Python replication of the experiments in Sutton & Barto's book Reinforcement Learning: An Introduction (referred as the Book in the following), on which Zhang Shangtong has done a wonderful job.

Instead, it verifies important concepts in the Book in an independent and rigorous way and presents them in an interactive and animated way.

Not only does it help you better understand the Book, but also it corrects some errors neglected by Sutton and Barto.

Dependency

  • python (>=3.6)
  • numpy (>=1.16)
  • ploty (>=4.0)
  • pandas
  • tqdm

Features

  • Object-oriented programming
  • Jupyter notebook
  • Independent random number generators
  • Interactive plots
  • Animation

Author

ZHENG Wenjie