A platform for Applied Reinforcement Learning (Applied RL)
Clone or download
MisterTea and facebook-github-bot Fix conda requirements file location in docs
Summary: Pull Request resolved: #70

Differential Revision: D13115456

Pulled By: MisterTea

fbshipit-source-id: c56183555a000dae3b69334b8bda7e38f79530ed
Latest commit 2023696 Nov 18, 2018



Applied Reinforcement Learning @ Facebook

Build Status


Horizon is an open source end-to-end platform for applied reinforcement learning (RL) developed and used at Facebook. Horizon is built in Python and uses PyTorch for modeling and training and Caffe2 for model serving. The platform contains workflows to train popular deep RL algorithms and includes data preprocessing, feature transformation, distributed training, counterfactual policy evaluation, and optimized serving. For more detailed information about Horizon see the white paper here.

Algorithms Supported


Horizon can be installed via. Docker or manually. Detailed instructions on how to install Horizon can be found here.


Detailed instructions on how to use Horizon can be found here.


Horizon is released under a BSD license. Find out more about it here.