__init__.py

"""
---
title: Gated Linear Units and Variants
summary: >
  Train an auto-regressive transformer with Gated Linear Units and variants
  for the position-wise feedforward network (FFN).
---

# Gated Linear Units and Variants

* [Experiment that uses `labml.configs`](glu_variants/experiment.html)
* [Simpler version from scratch](glu_variants/simple.html)
"""