Skip to content
A platform for Applied Reinforcement Learning (Applied RL)
Python Scala Other
Branch: master
Clone or download
kittipatv and facebook-github-bot Move to tensorboard 1.14
Summary: Pull Request resolved: #157

Reviewed By: czxttkl

Differential Revision: D17507688

Pulled By: kittipatv

fbshipit-source-id: 5129481e13421d466547700d6dbd4fa3432b13ad
Latest commit 6c030da Sep 20, 2019


Applied Reinforcement Learning @ Facebook

Build Status


Horizon is an open source end-to-end platform for applied reinforcement learning (RL) developed and used at Facebook. Horizon is built in Python and uses PyTorch for modeling and training and Caffe2 for model serving. The platform contains workflows to train popular deep RL algorithms and includes data preprocessing, feature transformation, distributed training, counterfactual policy evaluation, and optimized serving. For more detailed information about Horizon see the white paper here.

Algorithms Supported


Horizon can be installed via. Docker or manually. Detailed instructions on how to install Horizon can be found here.


Detailed instructions on how to use Horizon can be found here.


Horizon is released under a BSD license. Find out more about it here.


@article{gauci2018horizon, title={Horizon: Facebook's Open Source Applied Reinforcement Learning Platform}, author={Gauci, Jason and Conti, Edoardo and Liang, Yitao and Virochsiri, Kittipat and Chen, Zhengxing and He, Yuchen and Kaden, Zachary and Narayanan, Vivek and Ye, Xiaohui}, journal={arXiv preprint arXiv:1811.00260}, year={2018} }


You can’t perform that action at this time.