Skip to content

AI Gateway CLI 1.0.0b33 (Public Preview)

Choose a tag to compare

@paulyuk paulyuk released this 16 Nov 17:10
· 66 commits to main since this release
a80e1c5

Quickstart | CLI Reference | Documentation

Highlights

  • Foundry & Azure OpenAI model endpoint defaults and deployment safety: az aigateway model create on Foundry and Azure OpenAI providers now defaults --supported-endpoints to /openai/v1/chat/completions, /openai/v1/responses, and /anthropic/v1/messages instead of /v1/... (preventing HTTP 404 routes on inference). Both model create and model update infer omitted deployment.modelName from /deployments/<name> resource IDs and reject mismatched modelName vs /deployments/<name> values client-side.
  • Model-alias shorthand, piping, and routing validation: az aigateway model-alias create, set, and update accept <provider>/models/<model> shorthand, piped JSON from az aigateway model create -o json (with clear -o json guidance on empty or table stdin), and validate backend pool bounds (1..30) plus integer priority (0..100) and weight (1..100) client-side.
  • MCP OAuth2 grant types, tool-filter semantics, and source helpers: az aigateway mcp create and update support clientCredentials and tokenExchange (entraOnBehalfOf / tokenExchange.federatedClientApplication) OAuth2 credentials without requiring interactive authorizationUrl/tokenUrl/clientId fields; mcp source add supports --url; mcp import reports skipped servers cleanly; mcp authorize validates OAuth2 endpoints cleanly; and mcp update --allow-list null clears an allow-list ("[]" exposes zero tools).
  • Gateway identity, API keys, pagination, and provider cleanup: Enables az aigateway create --mi-user-assigned, adds az aigateway api-key update, wires --max-items / --next-token pagination across child list commands, prevents accidental telemetry-exporter create overwrites, and paginates all alias pages during model-provider delete cleanup.

Canonical DX

# 1. Register a Foundry model (defaults to /openai/v1/chat/completions and infers modelName)
az aigateway model create \
  -g rg-ai \
  --gateway-name gw-01 \
  --provider-name foundry-eastus \
  -n gpt-5-mini \
  --api-format OpenAIChatCompletions \
  --deployment-config '{"resourceId":"/subscriptions/.../accounts/my-foundry/deployments/gpt-5-mini"}'

# 2. Route an alias across two backend models with explicit priority and weights
az aigateway model-alias create \
  -g rg-ai \
  --gateway-name gw-01 \
  -n prod-chat \
  --models '[
    {"model":"foundry-eastus/models/gpt-5-mini","priority":1,"weight":80},
    {"model":"foundry-westus2/models/gpt-5-mini","priority":2,"weight":20}
  ]'

# 3. Clear an MCP tool allow-list to expose all tools again
az aigateway mcp update \
  -g rg-ai \
  --gateway-name gw-01 \
  -n learn \
  --allow-list null

Install or Upgrade

macOS / Linux / WSL / Cloud Shell (Bash)

curl -fsSL https://raw.githubusercontent.com/Azure/aigateway/main/cli/install.sh | bash

Windows (PowerShell)

irm https://raw.githubusercontent.com/Azure/aigateway/main/cli/install.ps1 | iex

Direct Wheel Install

az extension remove --name aigateway 2>/dev/null || true
az extension add --upgrade --source https://github.com/Azure/aigateway/releases/download/cli-v1.0.0b33/aigateway-1.0.0b33-py3-none-any.whl --yes

Documentation URLs

Release Asset & Checksum