FAST: Feed-forward Assisted Transformers

Creating faster and more efficient transformers through novel fine-tuning methods

FAST: Feedforward-Augmented Sentence Transformers

Generalizing sentence embeddings to a wide range of natural language tasks using feedforward neural networks, with massive speedup on fine-tuning.

Setup

cd fast
conda create -y --name fast python==3.9
conda activate fast
pip install -r requirements.in