Repository navigation
🚀 local-jev v1.0.0 Production Flagship Release
Zero API keys. Zero cloud egress. Zero rate limits.
Run fast autonomous agent decision models (Choice, Score, Noul, Route) locally on your CPU in < 18ms.
🌟 Flagship Architecture
- Pure-Rust SIMD Quantized Tensor Layer (
src/tensor.rs): 4-way unrolled 8-bit quantized linear projection forward pass without C++ runtime dependencies. - Speculative Cascade Router (
src/cascade.rs): Short-circuits high-confidence queries in <1ms and flags ambiguous prompts for deep fallback. - Online Preference Learning & Bandit Feedback (
src/bandit.rs): Contextual UCB prior updates learning from real agent execution outcomes. - Fast Cosine Vector Context Index (
src/vector.rs): Sub-millisecond embedding search for prompt states. - Embedded Native MCP stdio Server (
local-jev mcp): Drop-in Model Context Protocol server for Claude Desktop, Cursor, and Hermes. - Micro-Batch Scheduler & Telemetry (
/metrics): Prometheus metrics for real-time observability. - Official Client SDKs: Turnkey Python (
local-jev) and TypeScript SDKs.
📦 Installation
cargo install local-jev🧪 Verification & Benchmarks
- 16/16 Tests Passing across all suites.
- Published to Crates.io: https://crates.io/crates/local-jev