Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Azure OpenAI config.toml keeps running into these errors~!!! #1033

Closed
LeoYoungChina opened this issue Apr 12, 2024 · 10 comments
Closed

Azure OpenAI config.toml keeps running into these errors~!!! #1033

LeoYoungChina opened this issue Apr 12, 2024 · 10 comments
Labels
installation problems with installation and setup severity:low Minor issues, code cleanup, etc

Comments

@LeoYoungChina
Copy link

this is the content of my config.toml file:
1

this is the errors keeps coming up:
2

@LeoYoungChina LeoYoungChina added the bug Something isn't working label Apr 12, 2024
@enyst
Copy link
Collaborator

enyst commented Apr 12, 2024

The error says to check docker ps. Write docker ps in console and see what it says. Does it give an error or what does it say?

@LeoYoungChina
Copy link
Author

The error says to check docker ps. Write docker ps in console and see what it says. Does it give an error or what does it say?

then i docker ps , it comes into 404 error, is there anything wrong with my Azure settings ? :

image

@enyst
Copy link
Collaborator

enyst commented Apr 12, 2024

It does look like something is wrong with model settings. I think "deployment name" is wrong, it should be the name of the embeddings deployment in Azure, not chat GPT deployment. Please try to find that, and change it.

@LeoYoungChina
Copy link
Author

It does look like something is wrong with model settings. I think "deployment name" is wrong, it should be the name of the embeddings deployment in Azure, not chat GPT deployment. Please try to find that, and change it.
is there any advices or full params example for azure open ai settings for us?
image

@LeoYoungChina
Copy link
Author

It does look like something is wrong with model settings. I think "deployment name" is wrong, it should be the name of the embeddings deployment in Azure, not chat GPT deployment. Please try to find that, and change it.
is there any advices or full params example for azure open ai settings for us?
image

still getting 404 errors coming up all the time

@enyst
Copy link
Collaborator

enyst commented Apr 12, 2024

I think it is again the wrong name: the model for embeddings is "text-embedding-ada-002". But the "deployment name" in Azure is a name of an Azure resource with this model that you have access to. It's a name probably similar with this, but not the same.
I'm confused too 😆 but really, look around at what they call deployment, related to embeddings.

@enyst enyst added installation problems with installation and setup severity:low Minor issues, code cleanup, etc and removed bug Something isn't working labels Apr 12, 2024
@VishalHaibatpure1
Copy link

VishalHaibatpure1 commented Apr 12, 2024

@LeoYoungChina : Please see if below instruction with screenshot from AzureStudio helps you

image

Please note: For LLM_EMBEDDING_DEPLOYMENT_NAME to work, you will have to do few changes mentioned here: #1027 (comment)

@enyst : Mostly this confusion on the deployment name and API version is happening for everyone. May be some detailed/special instructions will be required as part of Azure config doc for OpenDevin.

@enyst
Copy link
Collaborator

enyst commented Apr 12, 2024

@enyst : Mostly this confusion on the deployment name and API version is happening for everyone. May be some detailed/special instructions will be required as part of Azure config doc for OpenDevin.

We have just added a guide here:
https://github.com/OpenDevin/OpenDevin/blob/main/docs/documentation/AZURE_LLM_GUIDE.md

Please take a look and let us know what you think. Is it missing something relevant? Maybe this screenshot? I think it could help! 😄

@Umpire2018
Copy link
Contributor

Umpire2018 commented Apr 15, 2024

@he-aook I believe above pic can solve your question.

@enyst Suggest to add the screenshot to AZURE_LLM_GUIDE.md to avoid misunderstanding. And i think DEPLOYMENT_NAME is little bit confused, maybe rename it to LLM_EMBEDDING_SERVICE_NAME , and LLM_EMBEDDING_MODEL to LLM_EMBEDDING_TYPE ?

@rbren
Copy link
Collaborator

rbren commented Apr 15, 2024

Deduping all the azure OpenAI issues into this: #1042

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
installation problems with installation and setup severity:low Minor issues, code cleanup, etc
Projects
None yet
Development

No branches or pull requests

5 participants