This repository illustrates how to leverage the power of the Transformer architecture with the help of HuggingFace's package Transformers and PyTorch.
The projects follow a tutorial-like approach, where the implementation details are thoroughly discussed alongside with the code.
-
Text Classification with BERT
Text classification of movie reviews from the SST-2 dataset with DistilBERT. -
BERT Fine-Tuning
Fine-tuning a BERT model for text classification.