Repository navigation
Releases
Releases · ppradyoth/build-break-models-from-scratch
v1.0.0: Levels 1–5
The full MVP. Build each part of a language model from scratch, then break it with a published attack. A green test suite is the flag.
| Level | Build | Break |
|---|---|---|
| 1 | BPE tokenizer | token-boundary filter bypass; glitch-token detection |
| 2 | embeddings + retrieval | HotFlip retrieval poisoning; embedding inversion |
| 3 | attention + the whole transformer | prompt injection: attention has no notion of trust |
| 4 | sampling / decoding | flip a refusal by turning your own decoding knobs |
| 5 | install a refusal (fine-tune) | find the refusal direction, ablate it, watch refusals vanish |
Play all five levels in your browser, no clone needed: https://ppradyoth.github.io/build-break-models-from-scratch/
Next: Level 6 (GCG adversarial suffixes).