Skip to content

caldrix v0.1.0

Choose a tag to compare

View all tags
@jyothsnamutt jyothsnamutt released this 16 Oct 10:42
· 58 commits to main since this release
v0.1.0
af8eabf

The first release.

Added

  • caldrix run <model>: chat with a model in the terminal, or answer one prompt with -p.
  • caldrix serve <model>: an OpenAI-compatible HTTP server, on port 8425 by default, with
    POST /v1/chat/completions (streaming or not), POST /v1/completions and GET /v1/models.
  • caldrix doctor: reports which lanes this machine can run: hip (AMD GPUs through ROCm),
    metal (Apple silicon) and cpu.
  • Models by alias (smollm2, llama-8b, qwen3-0.6b), by Hugging Face name
    (owner/name[@revision]) or from a local directory, for the Llama, Qwen2 and Qwen3 architectures.
  • A release archive for Linux on x86_64 (glibc 2.38 or newer), installed with
    curl -fsSL https://caldrix.ai/install.sh | sh.

Known limitations

  • There is no macOS archive in this release yet; it will be added to this release when it is built.
  • Generation is greedy: sampling parameters are refused.
  • NVIDIA GPUs, mixture-of-experts models and quantized checkpoints are not supported.
Assets 4
Loading