Skip to content

Pretrained tiny-shakespeare char-LM (v0.1)

Latest

Choose a tag to compare

@crasmarum crasmarum released this 07 Oct 07:02
· 35 commits to main since this release

Fully-complex Born-rule attention + RoPE + TokenNorm model, val 1.52 nats/char (~2.1M complex params). Load with a CNet build: ./dp_shakespeare -generate true -model rope20k.mod -prompt 'ROMEO:'