-
Notifications
You must be signed in to change notification settings - Fork 108
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Azure OpenAI integration #323
Comments
@TempoShaman Thanks for reaching out! We have provided a document demonstrating how to add your preferred LLM or Document Store. Please check out this guide: https://docs.getwren.ai/installation/custom_llm. We are using Haystack underneath, and it already supports Azure OpenAI. I think you can integrate it within 30 minutes. We welcome your contributions! Thank you! https://docs.haystack.deepset.ai/docs/azureopenaigenerator Feel free to ask us any questions! |
@TempoShaman after this PR is merged, you can start using Azure OpenAI I think :) |
@cyyeh firstly thanks for this solution, i was trying to explore this but i got stuck in the api key step, it is still asking for Open AI key whereas i want to add azure open AI keys. how can i proceed with this problem? |
@puneet1389 thanks for reaching out! We haven't added to our launcher yet. We'll write documentation for it later, thank you. Basically you clone the repo, fill in environment variables in the docker folder and docker-compose.yaml, then run Welcome to join our Discord server and checkout this link for further details: discussion: |
All, we now support using Azure OpenAI, Ollama, and OpenAI API-compatible LLMs now with the latest release: https://github.com/Canner/WrenAI/releases/tag/0.6.0 Setups on how to run Wren AI using custom LLMs: https://docs.getwren.ai/installation/custom_llm#running-wren-ai-with-your-custom-llm-or-document-store Currently, there is one obvious limitation for custom LLMs: you need to use the same provder(such as OpenAI, or Ollama) for LLM and embedding model. We'll fix that and release a new version soon. Stay tuned 🙂 I'll close this issue as completed now. |
Is your feature request related to a problem? Please describe.
I can't use Azure OpenAI api-key.
Describe the solution you'd like
It would be nice to have option to use Azure OpenAI api-key for working with Wren.ai since this is main platform where I would like to use your solution.
Describe alternatives you've considered
One alternative can be using Azure OpenAI integration provided with Langchain but I am not certain that it would not cause any further issues. I have not tried it yet.
The text was updated successfully, but these errors were encountered: