Skip to content

LowKey v0.3.0

Choose a tag to compare

View all tags
@Ninido Ninido released this 04 Oct 21:46
· 4 commits to main since this release
v0.3.0
d3fdbfc
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Features

  • Router mode for multi-model serving
  • Clean model discovery (no hash prefixes, split file filtering)
  • Memory-based instance spawn/evict decisions
  • Per-model thermal profiles

Architecture

  • pkg/router/: OpenAI-compatible API gateway
  • pkg/router/instance_manager.go: dynamic process spawning
  • pkg/router/memory_*.go: platform-specific memory monitoring

Council review: approve with changes.

Assets 6
Loading