Skip to content

duplexjev 0.1.0

Choose a tag to compare

View all tags
@BKtensor BKtensor released this 23 Sep 14:02
· 82 commits to main since this release
v0.1.0
027ca8b

First release of the duplexjev package: batched typed decisions from speech or text with zero decode steps.

  • Decider / Question: any open causal LM (transcripts) or Ultravox-format speech checkpoints (audio).
  • Packed prefix sharing (one row per item, block-diagonal mask); token-budget batching; device="auto" sharding.
  • duplexjev serve: HTTP server that answers every request of a tick in one pass.
  • Verified on an A800: qa100 0.88–0.90 (Ultravox v0.6, audio) and 0.92 (Qwen3-32B, text); fp32 packed vs per-question max diff 2e-5.

Install: pip install "duplexjev[all]" (PyPI)

Assets 2
Loading