v0.9.2: Python 3.14 Fix + FineWeb Data Guide

Bug Fixes

• Fix prepare.py on Python 3.14: global declaration after usage became a
  SyntaxError in Python 3.14 (was a deprecation warning in 3.12-3.13). Fixed by
  passing tokens_per_shard as a function parameter.
• Fix download_fineweb.py: --max-docs now uses HuggingFace streaming mode
  so you don't download 20GB just to test with 5000 documents.

New: FineWeb-Edu Download Script

pip install numpy tokenizers datasets

# Quick test (5000 docs, ~30 seconds)
python3 scripts/download_fineweb.py --output data/fineweb_sp1024 \
    --vocab-size 1024 --max-docs 5000

# Full dataset (10B tokens, ~20GB download)
python3 scripts/download_fineweb.py --output data/fineweb_sp8192 --vocab-size 8192

See the new "Training data" section in the README for full details.

Install

brew tap mrothroc/mixlab https://github.com/mrothroc/mixlab
brew install mixlab