This repository contains a PyTorch implementation of the Transformer architecture in the paper Attention is All You Need.
This serves as an accompanying codebase for the blog post here.
The implemented model is trained on a Machine Translation task on Igbo-English sentence pairs.