Skip to content

v0.2.0 - OrcaRouter Provider & Free Qwen Models

Choose a tag to compare

View all tags
@laurentvv laurentvv released this 17 Aug 21:07
· 17 commits to main since this release
v0.2.0
33bba1e

🚀 NexusAI-Client v0.2.0 — OrcaRouter Provider & Free Qwen Models

📦 PyPI Package: https://pypi.org/project/nexusai-client/0.2.0/
📚 Documentation: INTEGRATION_GUIDE.md

🌟 Highlights of Version 0.2.0

Version 0.2.0 introduces full native integration with OrcaRouter, a zero-margin multi-provider gateway offering access to 100% free-tier models (-free), featuring qwen/qwen3.8-27b-free as the default model.

1. 🤖 New Provider: OrcaRouter

  • Direct Access: Use instantly via AIGateway("orcarouter") or AIGateway("orcarouter_free").
  • Default Model: qwen/qwen3.8-27b-free (Qwen 3.8 27B Free Tier).
  • Dynamic Free-Tier Discovery: Automatic detection and filtering of models ending with -free (deepseek/deepseek-v4-flash-free, deepseek/deepseek-v4-pro-free, tencent/hy3-free, orcarouter/free) in list_models(free_only=True).

2. 🔄 Enhanced Zero-Cost Fallback Chain (auto_fallback)

  • OrcaRouter joins the smart Zero-Cost-First routing pipeline.
  • In case of capacity limits or rate limiting (HTTP 429), the gateway fails over seamlessly to the next available provider in the chain.

3. ⚡ Improved Streaming & Error Handling

  • Enhanced asynchronous HTTP error parsing on SSE streams (stream_chat / stream_text), ensuring accurate upstream error extraction before stream consumption.

4. 🛠️ Updated CLI & Diagnostics

  • Full OrcaRouter support in verify_access.py (live latency benchmarks and quota inspection).
  • Catalog exploration and filtering in list_all_models.py (190+ discovered models).

📦 Installation & Upgrade

# With pip
pip install --upgrade nexusai-client

# With uv (Recommended)
uv add --upgrade nexusai-client

# With poetry
poetry add nexusai-client@latest

💡 Quick Example

import asyncio
from nexusai_client import AIGateway

async def main():
    # 1. Direct call to Qwen 3.8 27B Free via OrcaRouter
    async with AIGateway("orcarouter_free") as client:
        response = await client.generate_text("Summarize key advantages of Python 3.14 in 2 sentences.")
        print(f"[{response.provider} / {response.model}]:\n{response.text}")

    # 2. Global smart zero-cost fallback chain across all 10 providers
    async with AIGateway.auto_fallback() as client:
        response = await client.generate_text("Hello from NexusAI-Client!")
        print(f"Served by: {response.provider}")

if __name__ == "__main__":
    asyncio.run(main())

📊 Supported Providers Matrix (10 Total)

Provider Identifier Tier Default Model
Cerebras "cerebras" Free (CS-3) gpt-oss-120b
Cohere "cohere" Free (Trial) command-r-plus-08-2024
DeepSeek "deepseek" Paid (Ultra-low cost) deepseek-chat
Gemini Free "gemini_free" Free (AI Studio) gemini-2.5-flash
Gemini Pro "gemini_pro" Paid (Enterprise GCP) gemini-2.5-pro
Groq "groq" Free (LPU) llama-3.3-70b-versatile
Mistral AI "mistral" Free (Dev) mistral-small-latest
Nvidia NIM "nvidia_free" Free (1k credits) meta/llama-3.1-8b-instruct
OpenRouter "openrouter" Free & Paid openrouter/free
OrcaRouter ⭐ "orcarouter" Free & Paid qwen/qwen3.8-27b-free

🔗 Useful Links

Assets 4
Loading