Skip to content

local-jev v1.0.0: Flagship Production 1.0 Release

Latest

Choose a tag to compare

@ronitgupta138 ronitgupta138 released this 10 Oct 17:35
· 57 commits to main since this release
53cd292

🚀 local-jev v1.0.0 Production Flagship Release

Zero API keys. Zero cloud egress. Zero rate limits.
Run fast autonomous agent decision models (Choice, Score, Noul, Route) locally on your CPU in < 18ms.

🌟 Flagship Architecture

  • Pure-Rust SIMD Quantized Tensor Layer (src/tensor.rs): 4-way unrolled 8-bit quantized linear projection forward pass without C++ runtime dependencies.
  • Speculative Cascade Router (src/cascade.rs): Short-circuits high-confidence queries in <1ms and flags ambiguous prompts for deep fallback.
  • Online Preference Learning & Bandit Feedback (src/bandit.rs): Contextual UCB prior updates learning from real agent execution outcomes.
  • Fast Cosine Vector Context Index (src/vector.rs): Sub-millisecond embedding search for prompt states.
  • Embedded Native MCP stdio Server (local-jev mcp): Drop-in Model Context Protocol server for Claude Desktop, Cursor, and Hermes.
  • Micro-Batch Scheduler & Telemetry (/metrics): Prometheus metrics for real-time observability.
  • Official Client SDKs: Turnkey Python (local-jev) and TypeScript SDKs.

📦 Installation

cargo install local-jev

🧪 Verification & Benchmarks