Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Other Models on Azure #2

Open
xu23ai opened this issue May 18, 2023 · 1 comment
Open

Other Models on Azure #2

xu23ai opened this issue May 18, 2023 · 1 comment

Comments

@xu23ai
Copy link

xu23ai commented May 18, 2023

Hello @chuanqisun I hope this reaches you. Thank you for such a clean , elegant solution. I am not that familiar with this language.
I have a few questions. How can I run this on my own pc , are their any instructions or guidelines you may have?

Then how do I change the model on Azure as I am connecting to the same model. There are a few I setup like davinci or text models. Is there a way to select this or are you able to accept the entire endpoint url.

When I insert the entire url of the endpoint there is an error message. Hope you can advise, and thank you for this elegant piece of work. i like the minimalist feel

@chuanqisun
Copy link
Owner

chuanqisun commented May 18, 2023

Hey there, thanks for trying out the tool. There are different kinds of models on Azure. The older generations behave like text completion. The news generations behave like chat. text-davinci belongs to the older family of models which iter cannot support, because the entire UI is designed around the chat-based experience.

Iter does not accept the full url. It only accepts the host root url and automatically detects what models are compatible. If your model is not showing up, it is possible that you haven't deployed any compatible models on Azure yet. Specifically, you need to deploy gpt-3.5 turbo and gpt-4. There might be limited access imposed by Microsoft.

Related documentation

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants