Skip to content

caldrix v0.1.2

Choose a tag to compare

@jyothsnamutt jyothsnamutt released this 17 Oct 00:40
· 60 commits to main since this release

Added

  • The smollm2-instruct alias (HuggingFaceTB/SmolLM2-135M-Instruct), a SmolLM2 with a chat template
    for caldrix run. Its tokens are verified on the CPU lane (x86-64-v3) on a plain-text prompt; it is
    not verified on Metal or AMD GPUs, and no check covers the chat template.

Changed

  • caldrix run with a model that has no chat template (such as smollm2) stops each reply at 256
    tokens unless --max-tokens is given; before, a base model could run until the context filled.