Skip to content

Straydog v0.1.1 (pre-release)

Pre-release
Pre-release

Choose a tag to compare

View all tags
@rewroy rewroy released this 03 Nov 10:55
v0.1.1
c2450f4

Binaries withdrawn. The executables of this release named paths on the machine that built them, so they were removed on 2026-11-03. Use v0.1.2 or later.

A fix release of Straydog 0.1.0. It is still a pre-release. What Straydog does and how fast it runs are in the
v0.1.0 notes.

Fixes

  • DeepSeek-V4.1-Flash tool calls with no arguments. The model writes a call to a tool that takes no parameters with a
    blank line before its close, as the chat template does. Straydog dropped that call, so a client saw no call and the
    model's turn ended. It is now a call, as DeepSeek's reference parser reads it (a9cd367).
  • /props and /slots while DSpark drafts. They said "speculative": false and "speculative.n_max": 0 for
    DeepSeek-V4.1-Flash with its DSpark drafter placed. They now report its 3 drafts a pass (160f161).
  • The README says that Windows runs on NVIDIA GPUs only (0a9048b).

Downloads

  • straydog-v0.1.1-linux-x86_64-hip.tar.gz: the Linux executable with LICENSE, README.md and
    THIRD_PARTY_LICENSES.txt.
  • straydog-linux-x86_64-hip: the Linux executable alone.
  • straydog-v0.1.1-windows-x86_64-cuda.zip: the Windows executable with NVIDIA's cuBLAS DLLs (cublas64_13.dll,
    cublasLt64_13.dll, CUDA 13.3) and their license. It runs as is.
  • straydog-windows-x86_64-cuda.exe: the Windows executable alone. It needs the CUDA 13 runtime's cuBLAS on PATH.
  • THIRD_PARTY_LICENSES.txt: the notices and the licenses of every crate linked into either executable.
  • SHA256SUMS: the checksums of these files.

The Linux build needs:

  • x86_64 and glibc 2.39 or later (Ubuntu 24.04 or later);
  • the ROCm 10 runtime (libamdhip64, hipBLAS, hipBLASLt);
  • bubblewrap;
  • an RDNA4 GPU (gfx1201: Radeon AI PRO R9700, RX 9070 series).

For other AMD GPUs, build from source with STRAYDOG_GPU_ARCHITECTURES.

The Windows build runs on NVIDIA GPUs only; AMD GPUs on Windows are not supported. It needs:

  • x86_64 Windows;
  • an NVIDIA driver that supports CUDA 13;
  • an RTX 20, 30, 40 or 50 series GPU (75-real;86-real;89-real;120).
tar xzf straydog-v0.1.1-linux-x86_64-hip.tar.gz && cd straydog-v0.1.1-linux-x86_64-hip
./straydog setup    # choose a model and where it goes; downloads and authenticates it
./straydog          # serves http://127.0.0.1:8080

Known limitations

  • Windows runs on NVIDIA GPUs only. AMD GPUs are supported on Linux (ROCm), not on Windows.
  • DeepSeek-V4.1-Flash has run only on Linux with ROCm. Qwen3.8-Flash-Next runs on Windows with CUDA as well, down to 5-6 GB
    of VRAM and 32 GB of RAM.
  • The released Linux executable carries GPU code for gfx1201 only.

License

MIT. THIRD_PARTY_LICENSES.txt holds code and data from other projects, and the licenses of the Rust crates linked into
the Linux and Windows executables; the source has the same notices in THIRD_PARTY_NOTICES.md. The Windows zip's cuBLAS
DLLs are NVIDIA's, under the license beside them. Model weights are not part of Straydog: each bundle is downloaded from its
publisher and is under that publisher's license.

Assets 3
Loading