Skip to content

0.11.0

Choose a tag to compare

@ChrisRomp ChrisRomp released this 23 Mar 20:33
· 118 commits to main since this release

BYOK Provider Support (Experimental)

Connect your own model providers alongside GitHub Copilot models. Supports OpenAI-compatible APIs, Azure OpenAI, Anthropic, Ollama, vLLM, and any OpenAI-compatible endpoint. Built on the Copilot SDK's BYOK support.

Features

  • BYOK providers -- Configure external model providers under "providers" in config.json. Switch between Copilot and BYOK models with /model provider:model-id. (#131, #132)
  • /provider commands -- /provider lists configured providers with auth and model details. /provider test <name> checks connectivity and model availability. (#135)
  • Model-level wireApi override -- Mix models that need different wire protocols ("completions" vs "responses") on the same provider. Codex models can use "responses" while others default to "completions". (#135)
  • Provider-aware model resolution -- Bare model names resolve Copilot-first, then BYOK. Provider-prefixed names (e.g., ollama:qwen3:8b) target the provider directly. (#132)
  • Admin agent provider management -- Admin bots get guided help for adding/removing providers via /provider add. (#135)
  • /help providers -- New bridge docs topic covering BYOK config, commands, and troubleshooting. (#135)

Fixes

  • Quiet mode -- Fixed nudge response timing to hold quiet mode open during the nudge cycle. (#129, #130)
  • Model listing -- Current model indicator no longer doubles up when a BYOK model shares a name with a Copilot model. (#135)
  • BYOK error messages -- Provider-specific error wrapping (unreachable, auth failure, model not found) only triggers when the provider actually resolved, preventing misattribution of Copilot errors. (#135)
  • Reasoning effort display -- Suppressed for BYOK models that don't carry reasoning metadata, preventing inherited Copilot model capabilities from showing incorrectly. (#137)
  • Same-provider model switch -- Detects per-model wireApi changes and forces a new session when needed. (#135)

Documentation

  • New docs/byok.md -- Full BYOK setup guide with provider examples (Ollama, Azure, Anthropic), wire API compatibility, model resolution, troubleshooting.
  • Azure troubleshooting -- SDK URL construction patterns, common 404 causes, auth header differences by provider type.
  • Updated config.sample.json with Azure model-level wireApi example.

Known Limitations

  • /provider test uses OpenAI-compatible /models endpoint; may 404 on Azure (#136)
  • Reasoning effort passthrough to BYOK providers is unverified; display is suppressed until confirmed
  • BYOK models are excluded from automatic fallback chains unless explicitly added to fallbackModels