Repository navigation
2.0.0
Major release: digit becomes neuron, an interactive essay on neural networks, "From ink to meaning", rebuilt from scratch.
Features
- Part I, seeing: draw a digit with a mouse, a finger or a stylus and the 784-256-256-10 network recognizes it live, with its pixels, layers, output probabilities and the weight field of each neuron
- Part II, reading: eleven chapters on attention in a transformer, from query, key and value to the dot product, softmax, the weighted sum, word order, multiple heads and the causal mask, around one French sentence
- A "tired / wide" switch changes a single word and shows how the attention of "il" moves
- A halftone visual identity where the area of a dot carries the value, with an automatic or manual light / dark theme
- English by default and French under /fr/, with language detection on the first visit and an Alt+L shortcut
- Chapter navigation with a table of contents, a floating pill and a progress indicator
- Everything runs in the browser: no server, no account, no data sent anywhere
- New address: neuron.sylvain.sh