Repository navigation
local-jev v0.1.0: 100% Offline Drop-In Alternative to TypeSafe Jev
⚡ local-jev v0.1.0 Production Release
Zero API keys. Zero cloud egress. Zero rate limits.
Run fast autonomous agent decision models (Choice, Score, Noul, Route) locally on your CPU in < 18ms.
🚀 Features
- Drop-in REST Compatibility: Seamless drop-in replacement for TypeSafe Jev API via
export TYPESAFE_BASE_URL=http://localhost:8080/v1. - Single-Forward-Pass Logit Extraction: Zero autoregressive token decoding loops; evaluates decision probabilities in a single forward pass.
- Constrained Softmax: Masks vocabulary exclusively to candidate option token IDs with temperature scaling.
- Sub-Millisecond CPU Latency:
p50 = 1.0µsbenchmarked inference on AMD Ryzen CPU. - Self-Contained CLI: Includes
serve,choice,score,route, andbenchmarksubcommands.
📦 Installation
cargo install local-jev🧪 Verification & Health
- 5/5 Tests Passing in CI.
- Live on Crates.io: https://crates.io/crates/local-jev