feat(bedrock_httpx.py): Make Bedrock-Cohere calls Async + Command-R support

[krrishdholakia]

Title

Make Bedrock calls Async (by moving to using httpx for bedrock calls), starting with 'cohere'. Will let this bake across next week, before rolling out to other providers (Anthropic, Amazon, Mistral, Stability) and endpoints (image gen, embeddings).

Note: No user-change required

import os
from litellm import completion

os.environ["AWS_ACCESS_KEY_ID"] = ""
os.environ["AWS_SECRET_ACCESS_KEY"] = ""
os.environ["AWS_REGION_NAME"] = ""

response = completion(
  model="bedrock/cohere.command-r-plus-v1:0",
  messages=[{ "content": "Hello, how are you?","role": "user"}]
)

Relevant issues

Closes #3368
Closes #3362

Also removes 'load_dotenv' in all places except __init__.py and proxy_cli.py

Type

🆕 New Feature
🧹 Refactoring
🚄 Infrastructure

Changes

• new bedrock_httpx.py file
• cleanup of load_dotenv

Testing

• test_completion (sync + async)
• test_streaming (sync + async)

OS Tests (optional but appreciated):

• Tested on MacOS

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
litellm	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	May 12, 2024 4:25am