Skip to content

feat: add OVHcloud AI Endpoints built-in provider #3342

Description

@aheritier

Summary

Add ovhcloud as a first-class built-in alias provider for OVHcloud AI Endpoints, following the same pattern as the recently added baseten provider (PR #3341).

Motivation

Users are already using OVHcloud AI Endpoints today, but they must write verbose custom provider config (as shown in #3145):

providers:
  ovhcloud:
    api_type: openai_chatcompletions
    base_url: https://oai.endpoints.kepler.ai.cloud.ovh.net/v1
    token_key: OVH_AI_ENDPOINTS_ACCESS_TOKEN

models:
  ovh-qwen:
    provider: ovhcloud
    model: Qwen3.5-397B-A17B

With a built-in alias, users write just:

agents:
  root:
    model: ovhcloud/Qwen3.5-397B-A17B

OVHcloud AI Endpoints is noteworthy because several models (including Qwen3.5-397B-A17B) offer a free tier with no API key required (up to 2 req/s), making it an excellent option for trying docker-agent without any credentials. opencode.ai already supports this provider under the same alias name.

Implementation Plan

This is a straightforward alias provider — no new API client or streaming adapter needed. The streaming delta.reasoning quirk from #3145 is already handled in main.

Changes required

  1. Register the built-in alias in the provider registry (Go code) with:

    • Alias: ovhcloud
    • API type: openai_chatcompletions
    • Base URL: https://oai.endpoints.kepler.ai.cloud.ovh.net/v1
    • Token env var: OVH_AI_ENDPOINTS_ACCESS_TOKEN
  2. Documentation — new page docs/providers/ovhcloud/index.md covering setup, usage (inline + named model), available models, and a code-assistant example

  3. Provider overview — add ovhcloud row to both tables in docs/providers/overview/index.md

  4. Example YAMLexamples/ovhcloud/agent.yaml

Notable models to document

Model Notes
Qwen3.5-397B-A17B Free tier (no API key), 2 req/s
Qwen2.5-72B-Instruct Qwen 2.5 family
Llama-3.3-70B-Instruct Meta Llama 3.3
Mistral-7B-Instruct-v0.3 Mistral 7B
DeepSeek-R1 DeepSeek reasoning

References

Metadata

Metadata

Labels

area/docsDocumentation changesarea/providersFor features/issues/fixes related to LLM providers (Bedrock, LiteLLM, Qwen, custom, etc.)

Fields

No fields configured for Enhancement.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions