Skip to content

v1.1.0

Choose a tag to compare

View all tags
@keith-axe keith-axe released this 20 Jun 03:10
v1.1.0
3a42557

Added

  • AWS Bedrock connector: The gateway can now route requests to Amazon Bedrock using AWS SigV4 request signing. Configure a Bedrock credential in the console with an AWS access key and secret, choose your target region, and the gateway handles authentication and routes to Bedrock's Converse API. Supports all models available via the Converse endpoint (Claude, Titan, Llama, Mistral, and more).

  • GCP Vertex AI connector: The gateway can now route requests to Google Cloud Vertex AI using OAuth2 service account authentication. Configure a Vertex credential with a GCP service account JSON key, and the gateway handles token exchange and routes to the Vertex AI inference endpoint. Supports Gemini models and any other model available through your Vertex AI project.

  • Multi-tier pricing rules engine: Provider pricing now supports tiered rates based on token count and request mode — for example, Gemini 1.5 Pro's context-size tiers (≤128K vs >128K input tokens) or OpenAI reasoning models that bill thinking tokens separately. All built-in providers (Anthropic, OpenAI, Gemini) ship with pre-configured rules covering cache tokens, reasoning tokens, and context-size tiers.

  • ** field in action response:** Every response now includes a object with , , and . Streaming responses include metering as an SSE event immediately before the terminal signal. Client applications can display cost and token usage directly from the response without a separate records query.

  • ** in pricing manifest:** now includes a field on each model entry when a multi-rule pricing config is available. Tooling can use this to pre-populate pricing editors with provider defaults.

  • Per-connector request timeout: Custom connector definitions now support a field under to override the gateway's global connector timeout for that specific connector — useful for slow self-hosted models or high-latency regional endpoints.

  • Attribution label filter on records endpoint: now accepts (repeatable, ANDed) to filter execution records by attribution labels. For example returns only records whose contain both entries.

  • SDK: field in : The Python SDK's now accepts an parameter, allowing workload token configuration without environment variables.

Fixed

  • Anthropic streaming reliability: Streaming requests submitted via the action params interface now correctly activate SSE on the Anthropic connector. Non-streaming and raw-body requests are unaffected.

  • SIEM export delivery: Execution records are now reliably delivered to configured SIEM webhooks and syslog destinations. Previously, high-throughput conditions could cause export to be interrupted before delivery completed.

  • Accurate HTTP status codes on upstream errors: The gateway now returns when a connector request times out and when the client disconnects — with a structured error body in both cases — making it straightforward to distinguish these conditions in logs and load balancers.

  • Workload credential scoping after cache refresh: Workload-scoped credentials now maintain their scope restrictions correctly across cache refresh cycles, ensuring consistent enforcement as credentials are updated.

  • Pricing markup saved on partial updates: Updating only the markup multiplier on an org pricing override now saves and appears correctly in pricing history. No pricing data is required alongside the markup to persist the change.

Assets 22
Loading