v0.4.2 - Dynamic Model Management, Auto-Rotation & Smart Discovery
What's Changed in v0.4.2
馃殌 Dynamic Model Management & Auto-Rotation
- Automatic failover on HTTP 404 / 400: When a provider decommissions or deprecates a model (e.g. Groq deprecating \llama-3.3-70b-versatile), NexusAI intercepts the error, marks the model as unavailable, and seamlessly rotates to the next candidate model or dynamically discovers active models.
- Smart Chat Model Discovery: Providers adhering to the OpenAI-compatible standard automatically query the /models\ endpoint when needed, intelligently filtering out non-chat models (audio transcription, guardrails, embeddings, moderation).
- Resilient Fallback on Rate Limits & Timeouts: Rate limits (429) and timeouts now trigger candidate model rotation across Gemini, Groq, Cerebras, Nvidia, Mistral, Cohere, DeepSeek, OpenRouter, and OrcaRouter before failing over.
- Updated Default Models:
- Groq: \openai/gpt-oss-120b\ (0.33s latency)
- Gemini Free: \gemini-3.5-flash-lite\ (0.84s latency)
- Nvidia NIM: \meta/llama-3.1-8b-instruct\ (0.46s latency)
- Cohere: \command-r-plus-08-2024\ (0.77s latency)
- Full candidate fallback lists for all 10 providers.
馃И Quality & Tests
- Added test coverage for 404 auto-rotation, dynamic /models\ discovery, and rate limit rotation across providers (40 tests passing).
- Validated health status across all 10 providers in production conditions.
Full Changelog: v0.4.1...v0.4.2