Repository navigation
What's Changed in mini-infer v0.2.7
🧠 Embedded Agent Cognitive Memory Engine
- Added
mini_infer.memory.MemoryEnginewith zero external heavy database dependencies. - Powered by persistent SQLite WAL mode with an in-memory inverted index supporting BM25 scoring and subword token hashing.
- Four memory categories:
core,semantic,episodic, andworkingwith time-based importance decay and top-$k$ similarity queries. - New CLI commands:
mini-infer memory add "text" --category core --importance 0.9mini-infer memory query "search terms" --limit 5mini-infer memory listmini-infer memory stats
⚡ Sub-Byte Weight Quantization Integration
- Integrated
quantbench-engineto support sub-byte model weights:- INT4: 4-bit asymmetric block quantization (reducing 1.5B model weight footprint to ~900MB).
- INT8: 8-bit symmetric per-channel quantization.
- Ternary: 1.58-bit {-1, 0, +1} weight packing.
- 2:4 Structured Sparsity: 50% parameter sparsity with contiguous bitmask.
- Seamless CLI flags for
serveandchat:mini-infer serve --quant int4 --kv-cache-dtype automini-infer chat --quant int4
🛡️ CLI Polish & Upfront Validation
- Added immediate upfront validation for
--quantand--kv-cache-dtypeCLI parameters. Typos fail fast with informative options before model weight loading.
🔒 Enterprise Governance & CI Hardening
- Interactive GitHub Issue Forms for bug reports and feature requests.
- PR templates with mandatory architectural invariant checklists.
- Added
SECURITY.md,CODE_OF_CONDUCT.md, and.pre-commit-config.yaml. - Hardened cross-platform matrix CI (Windows + Linux, Python 3.10, 3.11, 3.12).
Full Changelog: v0.2.5...v0.2.7