v0.4.0-beta

Full Changelog: v0.3.0...v0.4.0-beta

v0.3.0

Summary

• UI overhaul for the web control plane
• Launch presets
• Parse tok/s speed from llama-server logs, with a 10s refresh timeout
• Assorted control-plane fixes and refinements

Install

Clone and build from the tag:

git checkout v0.3.0
cargo build --release

v0.2.0

Full Changelog: https://github.com/jacobzymet/tinyinference/commits/v0.2.0