Skip to content

v0.3.2 — Amazon Bedrock LLM Support

Choose a tag to compare

View all tags
@mathumathi-v mathumathi-v released this 22 Mar 11:32
· 16 commits to main since this release
v0.3.2
2316319

What's New

Amazon Bedrock LLM Provider

  • New bedrock provider using the Converse API — works with any Bedrock-hosted model:
    • Amazon Nova, Titan
    • Claude (via Bedrock)
    • Llama, Mistral, Cohere
  • Uses existing AWS IAM credentials — no separate API key required
  • Configurable region via llm.bedrock_region (defaults to us-east-1)

Bug Fixes

  • config set now parses YAML/JSON values — lists like '["us-east-1"]' and booleans like 'true' are stored as native types instead of raw strings. Fixes boto3 region iteration bug.
  • Tests skip gracefully when optional SDKs missing — Azure and GCP tests no longer fail with ImportError when azure-identity or google-cloud-bigquery aren't installed.

Setup

finops config set llm.provider bedrock
finops config set llm.model amazon.nova-pro-v1:0
finops config set llm.bedrock_region us-east-1

Tests

  • 7 new unit tests for Bedrock (134 total across all modules)
  • Covers: Converse API calls, empty/missing response handling, region config

Docs

  • Bedrock setup guide added to README (Option 5)
  • Architecture diagram updated
  • Config reference updated with bedrock_region

Full Changelog: v0.3.1...v0.3.2

Assets 2
Loading