A platform for Applied Reinforcement Learning (Applied RL)
Clone or download
MisterTea and facebook-github-bot Fix parametric assert
Summary: Fix parametric assert

Reviewed By: econti

Differential Revision: D13418332

fbshipit-source-id: 972e57a7d684378e8869aac4be957f21de9f29d8
Latest commit 8811106 Dec 11, 2018



Applied Reinforcement Learning @ Facebook

Build Status


Horizon is an open source end-to-end platform for applied reinforcement learning (RL) developed and used at Facebook. Horizon is built in Python and uses PyTorch for modeling and training and Caffe2 for model serving. The platform contains workflows to train popular deep RL algorithms and includes data preprocessing, feature transformation, distributed training, counterfactual policy evaluation, and optimized serving. For more detailed information about Horizon see the white paper here.

Algorithms Supported


Horizon can be installed via. Docker or manually. Detailed instructions on how to install Horizon can be found here.


Detailed instructions on how to use Horizon can be found here.


Horizon is released under a BSD license. Find out more about it here.