Follow the instructions in Discretization.ipynb to learn how to discretize continuous state spaces, to use tabular solution methods to solve complex tasks. The corresponding solutions can be found in Discretization_Solution.ipynb.
To learn about more advanced discretization approaches, refer to the following:
- Uther, W., and Veloso, M., 1998. Tree Based Discretization for Continuous State Space Reinforcement Learning. In Proceedings of AAAI, 1998, pp. 769-774.
- Munos, R. and Moore, A., 2002. Variable Resolution Discretization in Optimal Control. In Machine Learning, 49(2), pp. 291-323.