Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Need help with azure config #389

Closed
haouarihk opened this issue Jun 4, 2024 · 1 comment
Closed

Need help with azure config #389

haouarihk opened this issue Jun 4, 2024 · 1 comment
Labels
bug Something isn't working triage

Comments

@haouarihk
Copy link

haouarihk commented Jun 4, 2024

What Happened?

I searched the documentation extensively but could not find any information on configuring azure-openai in the config object.

What Should Have Happened?

The documentation should include detailed guidance on configuring azure-openai.

Relevant Code Snippet

here's my config example

{
  "strategy": {
    "mode": "loadbalance"
  },
  "targets": [
    {
      "provider": "openai",
      "api_key": "sk-proj-",
      "weight": 1
    },
    {
      "provider": "azure-openai",
      "api_key": "sk-proj-",
      "azureResourceName": "AZURE_RESOURCE_NAME",
      "azureDeploymendId": "AZURE_DEPLOYMENT_NAME",
      "azureApiVersion": "AZURE_API_VERSION",
      "weight": 1
    }
  ]
}

Your Twitter/LinkedIn

@haouarihk

@haouarihk haouarihk added the bug Something isn't working label Jun 4, 2024
@github-actions github-actions bot added the triage label Jun 4, 2024
@vrushankportkey
Copy link
Collaborator

Hey @haouarihk, sorry for that! Here's the config for Azure that should work:

{
  "strategy": {
    "mode": "loadbalance"
  },
  "targets": [
    {
      "provider": "openai",
      "api_key": "sk-proj-",
      "weight": 1
    },
    {
      "provider": "azure-openai",
      "api_key": "sk-proj-",
      "resource_name": "AZURE_RESOURCE_NAME",
      "deployment_id": "AZURE_DEPLOYMENT_NAME",
      "api_version": "AZURE_API_VERSION",
      "weight": 1
    }
  ]
}

Also updating on the docs. Thanks for the nudge!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working triage
Projects
None yet
Development

No branches or pull requests

2 participants