Skip to content
#

decoder-only-transformer

Star

Here are 2 public repositories matching this topic...

Language: Python
Filter by language
All 3 Python 2 C 1

shaheennabi / Decoder-Only-Transformer-Architecture-Implementation-in-Pytorch

Sponsor
Star 2

A complete implementation of a Decoder-Only Transformer (GPT-style) built using PyTorch, without relying on high-level abstractions. This implementation includes all core components: token embeddings, positional embeddings, multi-head self-attention, feedforward networks, causal masking, and output logits generation.

attention-is-all-you-need positional-encoding masked-attention decoder-only-transformer
  • Updated Feb 18, 2026
  • Python

Improve this page

Add a description, image, and links to the decoder-only-transformer topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the decoder-only-transformer topic, visit your repo's landing page and select "manage topics."

Learn more