Repository navigation
v0.7.0
Summary
Introduces intelligent hardware-based model recommendations, server capability discovery with dynamic token budgeting, direct syndication feed ingestion in
srz news, and normalized DuckDB storage.
Changes
- Hardware Advisor & Tailored Setup (
srz recommend): Inspects host RAM tier to recommend optimal Gemma 4 Q8_0 models, launch commands, and context windows (with--jsonsupport);srz config initnow auto-populates hardware-tailored defaults and provides connection error guidance. - Dynamic Token Budgeting (
DynamicBudget): Automatically detects server context window (n_ctx) and slot capacity to mathematically size prompt budgets, chunk overlap, and completion headroom without manual tuning or OOMs. - Server-Native Tokenization (
POST /tokenize): Queries native/tokenizeendpoints inllama.cpp,Ollama, andvLLMfor exact token counting across code and multilingual text, cached in DuckDB for instant startup. - Syndication Feed Ingestion (
srz news): Supports direct RSS, Atom, and JSON feed URLs with feed auto-detection, concurrent article scraping, and offline caching. - Storage & Engine Performance: Unified DuckDB SQL LRU cache eviction, eliminated dual-writes, and added
--context-window,--max-tokens, and--concurrencyflags for fine-grained runtime control.