Skip to content

Add Ollama Cloud as built-in provider #3926

Description

@goemonwanwan

Problem

Ollama Cloud (https://ollama.com) is a cloud inference service with OpenAI-compatible API. Currently, users must configure it via custom_providers, but this causes issues:

  1. The provider: ollama-cloud setting is not recognized in auxiliary sections
  2. Workaround requires provider: custom + redundant base_url + api_key in every auxiliary task config
  3. PROVIDER_REGISTRY in auth.py does not include ollama-cloud

Proposed Solution

Add ollama-cloud to PROVIDER_REGISTRY in hermes_cli/auth.py:

"ollama-cloud": ProviderConfig(
    id="ollama-cloud",
    name="Ollama Cloud",
    auth_type="api_key",
    inference_base_url="https://ollama.com/v1",
    api_key_env_vars=("OLLAMA_CLOUD_API_KEY",),
),

Also add default auxiliary model in auxiliary_client.py:

_API_KEY_PROVIDER_AUX_MODELS["ollama-cloud"] = "nemotron-3-super"

Benefit

Before (workaround):

auxiliary:
  vision:
    provider: custom
    base_url: https://ollama.com/v1
    api_key: xxx
    model: qwen3.5:cloud

After (with built-in provider):

auxiliary:
  vision:
    provider: ollama-cloud
    model: qwen3.5:cloud

API key can be set via OLLAMA_CLOUD_API_KEY environment variable or custom_providers entry.

Related

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions