Skip to content

v0.7.0

Choose a tag to compare

@github-actions github-actions released this 01 Nov 04:29
· 291 commits to master since this release

Summary

Introduces intelligent hardware-based model recommendations, server capability discovery with dynamic token budgeting, direct syndication feed ingestion in srz news, and normalized DuckDB storage.

Changes

  • Hardware Advisor & Tailored Setup (srz recommend): Inspects host RAM tier to recommend optimal Gemma 4 Q8_0 models, launch commands, and context windows (with --json support); srz config init now auto-populates hardware-tailored defaults and provides connection error guidance.
  • Dynamic Token Budgeting (DynamicBudget): Automatically detects server context window (n_ctx) and slot capacity to mathematically size prompt budgets, chunk overlap, and completion headroom without manual tuning or OOMs.
  • Server-Native Tokenization (POST /tokenize): Queries native /tokenize endpoints in llama.cpp, Ollama, and vLLM for exact token counting across code and multilingual text, cached in DuckDB for instant startup.
  • Syndication Feed Ingestion (srz news): Supports direct RSS, Atom, and JSON feed URLs with feed auto-detection, concurrent article scraping, and offline caching.
  • Storage & Engine Performance: Unified DuckDB SQL LRU cache eviction, eliminated dual-writes, and added --context-window, --max-tokens, and --concurrency flags for fine-grained runtime control.