Skip to content

v0.7.15 — Faster API Response, 30s Timeout & Cleaner Combos UI

Choose a tag to compare

@neuralnexustech neuralnexustech released this 24 Sep 06:34
· 69 commits to main since this release

Fixes in v0.7.15

UI Fix

  • Removed top healing banner — the 🔄 Auto-Healing In Progress bar at the top of the Combos page is gone. Healing status is still shown inline on each individual tier card (colored glow + countdown + Heal button), so you can still see which model is recovering and why.

Performance — Faster API Responses

  • 30-second upstream timeout added to all provider fetch calls. Previously if a provider (e.g. OpenRouter under load) stalled, your request would hang indefinitely. Now it auto-fails over to the next tier within 30 seconds.
  • Timed-out providers enter 30s cooldown — after a timeout, that provider is automatically skipped on subsequent requests until it recovers (same as 5xx errors).
  • Faster first-token delivery (TTFT): peekStreamForFailover previously buffered up to 4 chunks before deciding if a stream is healthy. Now it commits on the first chunk as soon as healthy content (delta/content) is detected — eliminating 50–300ms of unnecessary buffering on every streaming request.
  • 10-second stall detection in stream peek — if a provider sends an HTTP 200 but then stalls without sending any bytes, it's now detected and failed over within 10s.