Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

allow custom API URLs in ChatGPTSession #52

Merged
merged 1 commit into from
Jul 18, 2023
Merged

Conversation

Vokturz
Copy link
Contributor

@Vokturz Vokturz commented Jul 16, 2023

This change allows a custom api_url to be used when creating a ChatGPTSession.

Previously, if you instantiated AIChat with a custom api_url as a string, it resulted in an error when httpx attempted to send the request. For instance:

ai = AIChat(api_key='None', api_url='http://localhost:8000/v1/chat/completions', console=False)

Invalid type for url. Expected str or httpx.URL, got <class 'pydantic_core._pydantic_core.Url'>: Url('http://localhost:8000/v1/chat/completions')

Now, the api_url is cast to a string before it is used with httpx. This effectively removes the error and enables the use of a custom API URL.

This can be useful in scenarios where requests need to be rerouted to a local server or a different API endpoint for development or testing purposes. A practical example of this is when using an open-source Language Model with an OpenAI-like API web server, such as the one provided by llama.cpp.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants