Skip to content

v0.4.2 - Dynamic Model Management, Auto-Rotation & Smart Discovery

Choose a tag to compare

@laurentvv laurentvv released this 18 Aug 14:27
· 1 commit to main since this release

What's Changed in v0.4.2

馃殌 Dynamic Model Management & Auto-Rotation

  • Automatic failover on HTTP 404 / 400: When a provider decommissions or deprecates a model (e.g. Groq deprecating \llama-3.3-70b-versatile), NexusAI intercepts the error, marks the model as unavailable, and seamlessly rotates to the next candidate model or dynamically discovers active models.
  • Smart Chat Model Discovery: Providers adhering to the OpenAI-compatible standard automatically query the /models\ endpoint when needed, intelligently filtering out non-chat models (audio transcription, guardrails, embeddings, moderation).
  • Resilient Fallback on Rate Limits & Timeouts: Rate limits (429) and timeouts now trigger candidate model rotation across Gemini, Groq, Cerebras, Nvidia, Mistral, Cohere, DeepSeek, OpenRouter, and OrcaRouter before failing over.
  • Updated Default Models:
    • Groq: \openai/gpt-oss-120b\ (0.33s latency)
    • Gemini Free: \gemini-3.5-flash-lite\ (0.84s latency)
    • Nvidia NIM: \meta/llama-3.1-8b-instruct\ (0.46s latency)
    • Cohere: \command-r-plus-08-2024\ (0.77s latency)
    • Full candidate fallback lists for all 10 providers.

馃И Quality & Tests

  • Added test coverage for 404 auto-rotation, dynamic /models\ discovery, and rate limit rotation across providers (40 tests passing).
  • Validated health status across all 10 providers in production conditions.

Full Changelog: v0.4.1...v0.4.2