Skip to content

v0.1.0

Choose a tag to compare

View all tags
@joa joa released this 25 Sep 17:56
· 12 commits to main since this release
v0.1.0
0a12e88

First release of Phobos 🎉

  • phobos-cli: Inference engine for GGUF models.; OpenAI-compatible or a simple REPL
  • phobos-bench: Measure prefill and decode throughput
  • phobos-compile: Compiles Phobos source code to PTX
  • phobos-cache: Utilities for the local compiler cache

This release includes a pre-warmed cache for all supported SM architectures.

Dependencies: NVIDIA driver that supports CUDA 13.0.

Assets 5
Loading