Home

Welcome to the fluence wiki!

Fluence is a Pytorch based deep learning library focussed on providing computationally efficient, low resource methods and algorithms. Although the main focus is to provide support with transformers, it can be extended with other architectures as well.

Currently, it provides support for the following:

• Adaptive Methods

  • Adaptive Attention Span
  • Adaptively Sparse Transformers
  • Layerdrop

• Importance sampling

  • Clustering

• Meta Learning

  • MAML

Installation

For stable (recommended) version

pip3 install --user fluence

For development version

python3 setup install --user