Liangyu Zhang, Yang Peng, Wenhao Yang, Zhihua Zhang. Semi-infinitely Constrained Markov Decision Processes. NeurIPS 2022.
- Gurobipy
- OpenAI Gym:
pip install gym gym[atari]
The customized environments Toy SICMDP and Discharge of Sewage are implemented in toymdp_env.py and pollution_env.py respectively.
Some utility functions and the algorithm SI-CRL are included in SICMDP.py.
The python files with prefix experiment are for the experiments in the paper.