Skip to content
Branch: master
Find file History
trax-robot and Copybara-Service Separate ff_dropout hparam to control Reformer relu dropout
PiperOrigin-RevId: 295280650
Latest commit 85a4d41 Feb 15, 2020

Reformer: The Efficient Transformer

Reformer is a more efficient version of Transformer that uses reversible layers and locality-sensitive hashing.

Read about the details in our Reformer paper which was selected for oral presentation at ICLR 2020.

Generate images with Reformer using this colab.

Train Reformer on text of length 0.5M tokens on a single 8GB accelerator code using this colab.

You can’t perform that action at this time.