Skip to content

v0.7.14 — Smart Auto-Healing & Combos Health Dashboard

Choose a tag to compare

@neuralnexustech neuralnexustech released this 24 Sep 06:15
· 69 commits to main since this release

🚀 What's New in v0.7.14

  • Smart Auto-Healing Across All Strategies:
    • Cooldowns and healing now apply universally across Failover, Round-Robin, Weighted, LKGP, Latency-Based, and Cost-Optimized combos.
    • Automatically skips failing/exhausted models until they recover:
      • RPM / Short Rate Limits (429): Cooldown for 60 seconds, then auto-re-enters routing pool.
      • Daily Quotas / RPD Exceeded (403): Automatically waits until 00:00 UTC (tomorrow) before re-enabling.
      • Server Outages (500 / 502 / 503 / 504): Cooldown for 30 seconds for transient recovery.
      • Auth / Key Errors (401): 5-minute cooldown.
  • Live Combos Health UI:
    • Top auto-healing status banner showing count of recovering models.
    • Per-model live status cards with glowing amber indicators, remaining countdown timers, and reason badges.
    • Manual ⚡ Heal button to immediately reactivate models on demand.
  • Streaming EOF Resilience:
    • Normalized stream end-of-file handling (unexpected EOF / client disconnect) as clean stream completion rather than an upstream failure.
    • Prevents false-positive failover loops when clients disconnect.
  • Provider & Model Accuracy Improvements:
    • Verified model capability queries and provider pulling.