Skip to content

Straydog v0.1.3 (pre-release)

Pre-release
Pre-release

Choose a tag to compare

View all tags
@rewroy rewroy released this 04 Nov 06:28
v0.1.3
005f8ab

Straydog 0.1.3. It is still a pre-release. What Straydog does and how fast it runs are in the
v0.1.0 notes.

The executables of v0.1.0 and v0.1.1 named paths on the machine that built them. Those binaries were withdrawn, and v0.1.2
was withdrawn as well. This release replaces them and holds their fixes.

Changes

  • Windows: a model on a second drive starts. The contained worker no longer opens and resolves the model and drafter
    directories itself; it takes the paths the server resolved. With the model on a second drive, the engine could stop at
    start with "Access is denied (os error 5)".

  • Windows: a refused start says why. When the worker is refused access at start, the error names the cause: a drive
    that keeps no file permissions (exFAT, FAT32), or a path the worker has no read permission on.

  • Release executables and archives name no builder paths. The GPU library's __FILE__ is relative to its folder, the
    release builds map the Rust dependencies' paths to ~, and the Linux tarball's files are owned by root.

  • straydog setup --force. With --quant, it sets up the named bundle even when it needs more free VRAM than there is
    now, for example while other programs hold the GPU. It sets the smallest context and says so, and at load it waits for
    the VRAM. A machine with no GPU is still refused.

From v0.1.1:

  • DeepSeek-V4.1-Flash tool calls with no arguments are read as calls, as DeepSeek's reference parser reads them.
  • /props and /slots report DSpark's drafting.

Downloads

  • straydog-v0.1.3-linux-x86_64-hip.tar.gz: the Linux executable with LICENSE, README.md and
    THIRD_PARTY_LICENSES.txt.
  • straydog-linux-x86_64-hip: the Linux executable alone.
  • straydog-v0.1.3-windows-x86_64-cuda.zip: the Windows executable with NVIDIA's cuBLAS DLLs (cublas64_13.dll,
    cublasLt64_13.dll, CUDA 13.3) and their license. It runs as is.
  • straydog-windows-x86_64-cuda.exe: the Windows executable alone. It needs the CUDA 13 runtime's cuBLAS on PATH.
  • THIRD_PARTY_LICENSES.txt: the notices and the licenses of every crate linked into either executable.
  • SHA256SUMS: the checksums of these files.

The Linux build needs:

  • x86_64 and glibc 2.39 or later (Ubuntu 24.04 or later);
  • the ROCm 10 runtime (libamdhip64, hipBLAS, hipBLASLt);
  • bubblewrap;
  • an RDNA4 GPU (gfx1201: Radeon AI PRO R9700, RX 9070 series).

For other AMD GPUs, build from source with STRAYDOG_GPU_ARCHITECTURES.

The Windows build runs on NVIDIA GPUs only; AMD GPUs on Windows are not supported. It needs:

  • x86_64 Windows;
  • an NVIDIA driver that supports CUDA 13;
  • an RTX 20, 30, 40 or 50 series GPU (75-real;86-real;89-real;120).
tar xzf straydog-v0.1.3-linux-x86_64-hip.tar.gz && cd straydog-v0.1.3-linux-x86_64-hip
./straydog setup    # choose a model and where it goes; downloads and authenticates it
./straydog          # serves http://127.0.0.1:8080

Known limitations

  • Windows runs on NVIDIA GPUs only. AMD GPUs are supported on Linux (ROCm), not on Windows.
  • DeepSeek-V4.1-Flash has run only on Linux with ROCm. Qwen3.8-Flash-Next runs on Windows with CUDA as well, down to 5-6 GB
    of VRAM and 32 GB of RAM.
  • The released Linux executable carries GPU code for gfx1201 only.

License

MIT. THIRD_PARTY_LICENSES.txt holds code and data from other projects, and the licenses of the Rust crates linked into
the Linux and Windows executables; the source has the same notices in THIRD_PARTY_NOTICES.md. The Windows zip's cuBLAS
DLLs are NVIDIA's, under the license beside them. Model weights are not part of Straydog: each bundle is downloaded from its
publisher and is under that publisher's license.

Assets 8
Loading