Skip to content

2.0.0

Choose a tag to compare

@20syldev 20syldev released this 12 Oct 21:49
· 11 commits to master since this release
2.0.0
2895b39

Major release: digit becomes neuron, an interactive essay on neural networks, "From ink to meaning", rebuilt from scratch.

Features

  • Part I, seeing: draw a digit with a mouse, a finger or a stylus and the 784-256-256-10 network recognizes it live, with its pixels, layers, output probabilities and the weight field of each neuron
  • Part II, reading: eleven chapters on attention in a transformer, from query, key and value to the dot product, softmax, the weighted sum, word order, multiple heads and the causal mask, around one French sentence
  • A "tired / wide" switch changes a single word and shows how the attention of "il" moves
  • A halftone visual identity where the area of a dot carries the value, with an automatic or manual light / dark theme
  • English by default and French under /fr/, with language detection on the first visit and an Alt+L shortcut
  • Chapter navigation with a table of contents, a floating pill and a progress indicator
  • Everything runs in the browser: no server, no account, no data sent anywhere
  • New address: neuron.sylvain.sh