PlaNet: A Deep Planning Network for Reinforcement Learning. Supports symbolic/visual observation spaces. Supports some Gym environments (including classic control/non-MuJoCo environments, so DeepMind Control Suite/MuJoCo are optional dependencies).
To install all dependencies with Anaconda run conda env create -f environment.yml and use source activate rainbow to activate the environment.