Skip to content

Releases

v1.0.0: Levels 1–5

Choose a tag to compare

@ppradyoth ppradyoth released this 28 Sep 22:48

The full MVP. Build each part of a language model from scratch, then break it with a published attack. A green test suite is the flag.

Level Build Break
1 BPE tokenizer token-boundary filter bypass; glitch-token detection
2 embeddings + retrieval HotFlip retrieval poisoning; embedding inversion
3 attention + the whole transformer prompt injection: attention has no notion of trust
4 sampling / decoding flip a refusal by turning your own decoding knobs
5 install a refusal (fine-tune) find the refusal direction, ablate it, watch refusals vanish

Play all five levels in your browser, no clone needed: https://ppradyoth.github.io/build-break-models-from-scratch/

Next: Level 6 (GCG adversarial suffixes).