Skip to content

v0.5.0 — Smart benchmarks, dynamic context, Fleet Intelligence, 8-tab dashboard

Choose a tag to compare

View all tags
@twinsgeeks twinsgeeks released this 14 Apr 23:31
· 227 commits to main since this release
v0.5.0
d368a24

Highlights

  • Smart benchmark system — auto-discovers fleet, fills available memory with recommended models, benchmarks LLM chat, embeddings, and image generation simultaneously
  • Dynamic num_ctx management — measures actual token usage, auto-adjusts context windows to free KV cache memory
  • Fleet Intelligence — LLM-powered briefings that analyze fleet health using the fleet's own models
  • /api/pull endpoint — pull models through the router, auto-selects best node by available memory
  • Dashboard overhaul — gradient progress bars, animated health ring, model badges by type, in-place SSE updates
  • 16 health checks total

Fixes

  • Context recommendation uses total tokens (prompt+completion) instead of prompt-only
  • Node card DOM flashing eliminated with in-place SSE updates
  • Fleet Intelligence prompt restricted to real commands only

See CHANGELOG.md for full details.

Install: pip install ollama-herd==0.5.0

Assets 2
Loading