Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support Azure OpenAI #602

Closed
2 tasks done
Tracked by #584
asimpson opened this issue Jul 28, 2023 Discussed in #601 · 3 comments
Closed
2 tasks done
Tracked by #584

Support Azure OpenAI #602

asimpson opened this issue Jul 28, 2023 Discussed in #601 · 3 comments
Assignees

Comments

@asimpson
Copy link
Contributor

asimpson commented Jul 28, 2023

Relevant docs

High-level tasks:

  • reach out to Azure to get access for testing and development
  • make URL field configurable since the URL changes based on the deployment of the model in Azure. We'll need two pieces:
    • Deployment name
    • Endpoint, e.g. https://docs-test-001.openai.azure.com/

image

Related to #584

Discussed in #601

Originally posted by vidommet July 27, 2023
Current OpenAI support only allows OpenAI key. Please expand that to use Azure's OpenAI instances and API keys

@jtheory
Copy link

jtheory commented Sep 29, 2023

@asimpson If you're ready to switch over to grafana-llm-app support for all your LLM API needs ✨ , Azure support is now stable over there -- tbh, partly driven by knowing you wanted the option. Plus it turned out to be pretty straightforward.

Let us know when when you're picking that up (happy to help), or if there are any blockers / concerns.

Incident Auto-summary migrated over by keeping dual support for now -- if grafana-llm-app is configured, use it, otherwise check for local LLM config -- and will drop the local config path in a future iteration.

@asimpson
Copy link
Contributor Author

@jtheory 🎉 Amazing, thanks for letting me know! 🏆

@asimpson asimpson self-assigned this Oct 6, 2023
@asimpson
Copy link
Contributor Author

asimpson commented Nov 9, 2023

Fixed in #699

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: Done
Development

No branches or pull requests

2 participants