Gym OpenAI Gym as a backend. Notes Currently does not support the mojoco backends as their licensing is crazy. Roadmap Support toy text rendering Support video and image state compression Pybullet