Skip to content

local-jev v0.1.0: 100% Offline Drop-In Alternative to TypeSafe Jev

Choose a tag to compare

@ronitgupta138 ronitgupta138 released this 10 Oct 17:07
· 68 commits to main since this release
a7ee36f

⚡ local-jev v0.1.0 Production Release

Zero API keys. Zero cloud egress. Zero rate limits.
Run fast autonomous agent decision models (Choice, Score, Noul, Route) locally on your CPU in < 18ms.

🚀 Features

  • Drop-in REST Compatibility: Seamless drop-in replacement for TypeSafe Jev API via export TYPESAFE_BASE_URL=http://localhost:8080/v1.
  • Single-Forward-Pass Logit Extraction: Zero autoregressive token decoding loops; evaluates decision probabilities in a single forward pass.
  • Constrained Softmax: Masks vocabulary exclusively to candidate option token IDs with temperature scaling.
  • Sub-Millisecond CPU Latency: p50 = 1.0µs benchmarked inference on AMD Ryzen CPU.
  • Self-Contained CLI: Includes serve, choice, score, route, and benchmark subcommands.

📦 Installation

cargo install local-jev

🧪 Verification & Health