This repo is a collection of all my implementations from scratch of the most popular machine learning models, algorithms, and/or methods. It contains the ready-to-use codes in the code folder, but also a more visually appealing version in the notebooks folder.

Implementations

• Transformer from scratch using PyTorch (from the paper "Attention is All You Need")
  • Self-Attention
  • Multi-Head Attention
  • Positional Encoding
  • Encoder
  • Decoder
  • Transformer