Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] Azure api 配置不生效 #4796

Open
1 of 3 tasks
wilber-F opened this issue May 29, 2024 · 10 comments
Open
1 of 3 tasks

[Bug] Azure api 配置不生效 #4796

wilber-F opened this issue May 29, 2024 · 10 comments
Labels
bug Something isn't working

Comments

@wilber-F
Copy link

Bug Description

使用了通用配置https://XXXX/openai/deployments/{deploy-name}不生效。不会自动替换{deploy-name}字段。请帮忙看看是什么地方配置错误。
docker run -d -p 4000:3000 -e "AZURE_URL=https://XXXXX.openai.azure.com/openai/deployments/{deploy-name}" -e AZURE_API_KEY=XXXXX -e AZURE_API_VERSION=2024-02-15-preview -e AZURE_OPENAI_MODEL_MAPPER="gpt-3.5-turbo=gpt-35-turbo" -e CUSTOM_MODELS=-all,+gpt-4o,+gpt-35-turbo yidadaa/chatgpt-next-web

Steps to Reproduce

更新了app到最新版,将部署名改成和模型名字一致,也加入过AZURE_OPENAI_MODEL_MAPPER,都无法生效。

Expected Behavior

请帮忙查看问题所在,谢谢

Screenshots

24f1c1d9ac688dd1f521df2d4341e4d
image
image

Deployment Method

  • Docker
  • Vercel
  • Server

Desktop OS

window11

Desktop Browser

chrome

Desktop Browser Version

No response

Smartphone Device

No response

Smartphone OS

No response

Smartphone Browser

No response

Smartphone Browser Version

No response

Additional Logs

No response

@wilber-F wilber-F added the bug Something isn't working label May 29, 2024
@Issues-translate-bot
Copy link

Bot detected the issue body's language is not English, translate it automatically.


Title: [Bug] Azure api configuration does not take effect

@EdiWang
Copy link

EdiWang commented May 30, 2024

Have you tried specifying the deployment name with a fixed value instead of {deploy-name} in your AZURE_URL?

e.g.

https://****.openai.azure.com/openai/deployments/gpt-4o

Then for CUSTOM_MODELS, set value to -all,+gpt-4o

@wilber-F
Copy link
Author

使用固定值的AZURE_URL是可以正常使用的,只有使用{deploy-name} 的方式会报错

@Issues-translate-bot
Copy link

Bot detected the issue body's language is not English, translate it automatically.


Using a fixed value of AZURE_URL can be used normally. Only using {deploy-name} will report an error.

@Mmahaha
Copy link

Mmahaha commented Jul 1, 2024

目前支持AZURE_OPENAI_MODEL_MAPPER这个参数吗,我看只是有人提了个PR

@Issues-translate-bot
Copy link

Bot detected the issue body's language is not English, translate it automatically.


Is the parameter AZURE_OPENAI_MODEL_MAPPER currently supported? I think someone just mentioned a PR.

@lloydzhou
Copy link
Contributor

可以参考这个pr #4930 的实现:

  1. 从数据结构上支持一个模型由多个服务商提供
  2. 没有添加新配置,而是使用display_name当作deployment_name使用(这个设定应该算合理)

@Issues-translate-bot
Copy link

Bot detected the issue body's language is not English, translate it automatically.


You can refer to the implementation of this PR #4930:

  1. Support one model provided by multiple service providers from the data structure
  2. No new configuration is added, but display_name is used as deployment_name (this setting should be reasonable)

@lloydzhou
Copy link
Contributor

@wilber-F

前面提到的pr已经合并,不知道你这边的问题是否已经得到解决?
image

@Issues-translate-bot
Copy link

Bot detected the issue body's language is not English, translate it automatically.


@wilber-F

The PR mentioned earlier has been merged. I wonder if the problem on your side has been resolved?
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

5 participants