Skip to content
This repository was archived by the owner on Aug 11, 2026. It is now read-only.

0.6.0

Choose a tag to compare

@finnvoor finnvoor released this 07 Jul 08:24
· 25 commits to main since this release

Emo 0.6.0 - transformer-pool model, ~800-emoji curated vocab.

  • New architecture: a tiny 2-layer transformer encoder + attention pool over the semantic token sequence (order-aware; composes phrases/idioms instead of averaging).
  • Curated ~800-emoji everyday vocab (foods, animals, objects, instruments, ...), near-duplicates merged.
  • Independent held-out top-1 (judged by an independent model): ~75% (0.5.0) -> ~78%.
  • On-device size ~5.0 MB (4-bit palettized).