how to replace an existing LLM model with another one

[Eva00062]

Thank you for this detailed guide; it's so thorough that even a liberal arts student like me was able to follow the steps and succeed. I'd like to know how to replace an existing LLM model with another one. What should I do.

Due to the national restrictions by OpenAI, the current API key was obtained through special channels. For frequent future use, I would like to switch to China's Moonshot as the LLM to interact with. Could you provide some tips or suggestions on how to implement this feature? I look forward to your reply, thank you!

Here is the link to the Moonshot API documentation for your reference: https://platform.moonshot.cn/docs/api-reference.

[vivekuppal]

In the file app\transcribe\override.yaml please add these lines

'''
OpenAI:
api_key: 'MOONSHOT_API_KEY'
base_url: 'https://api.moonshot.cn/v1'
ai_model: 'moonshot-v1-8k'
'''

I believe you should be able to use the Moonshot LLM hosted by the Chinese provider at the URL 'https://api.moonshot.cn/v1'

[vivekuppal]

Seems like the issue has been resolved. Reopen if you need further help.