Skip to content

CrystalLM

Choose a tag to compare

View all tags
@Player9753193 Player9753193 released this 15 Jan 10:39
· 1 commit to main since this release
v1.1.1
43c5491
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

🚀 Vocabulary-Governed GRU Release

This release marks a structural stabilization milestone for CrystalLM.

✨ Highlights

  • GRU-based word-level language model

    • Replaced earlier experimental RNN variants with a stable multi-layer GRU
    • Improved training stability and long-context behavior

  • Vocabulary governance refined

    • Explicit low-frequency pruning
    • More controlled <UNK> mapping
    • Reduced vocabulary noise and improved generation coherence

  • Generation behavior improved

    • Fixed premature <END> termination
    • Temperature sampling behavior is now consistent and predictable

  • Training workflow hardened

    • More stable loss convergence
    • CPU-friendly training path (Intel Mac verified)
    • Checkpoint reuse without retraining

🎯 Scope & Intent

This release prioritizes clarity, correctness, and observability over scale.
It represents a solid educational baseline for understanding word-level language modeling before moving to Transformers.

Assets 2
Loading