Zenith 1.0 — a from-scratch generative NLP library, now stable and on PyPI.
pip install "zenith-nlp[all]"A complete, honest, from-scratch decoder-only LM stack:
- Modern architecture — Llama-style (RoPE, RMSNorm, SwiGLU) with an optional fused SDPA path; configurable GPT-2-style.
- Generation — greedy / temperature / top-k / nucleus / beam / streaming, plus greedy-exact speculative decoding.
- Training & scaling — causal-LM trainer, LoRA / AMP / DDP, a measured scaling study, and honest benchmarks (matches nanoGPT: 2.08 bits/char on tiny-shakespeare).
- Instruction tuning — response-only-masked SFT into a mini chat model (
zenith chat --instruct), with a model card. - int8 quantized inference, a vectorized from-scratch BPE, FastAPI serving + SSE, MLflow tracking, Hydra configs, and optional Polaris interop.
103 tests on Python 3.10–3.12, 11 ADRs, 11 design docs, benchmark figures. The public API follows semantic versioning from here.
Full history in CHANGELOG.md.