Skip to content

v1.2.3 — Qwen2.5-0.5B-Instruct default model

Choose a tag to compare

@xezpeleta xezpeleta released this 27 Jun 12:01

What's Changed

  • Default Transformer.js model upgraded to Qwen2.5-0.5B-Instruct (from SmolLM2-135M-Instruct)
    • 500M params (3.7× larger), significantly better completions
    • IFEval ~51 vs 29.9 (SmolLM2-135M)
  • Default dtype changed from q4 to q4f16 (~500MB download)
  • Uses Transformers.js v3+ native chat template (messages API instead of manual <|im_start|> formatting)
  • Default maxNewTokens increased from 30 to 40

Model comparison

Model Params IFEval Download
SmolLM2-135M-Instruct (old) 135M 29.9 ~30MB (q4)
Qwen2.5-0.5B-Instruct (new) 500M ~51 ~500MB (q4f16)