title | order |
---|---|
Using Oobabooga |
12 |
You can find the full Oobabooga documentation here.
python3 -m venv venv
source venv/bin/activate
# choose correct requirements.txt for your system
pip install -r requirements.txt
# install the openai extension
pip install -r extensions/openai/requirements.txt
python server.py --api
Open http://127.0.0.1:7860/ in your browser and configure the server.
Make sure you load the model in the "Model" tab.
Set ChatBot Backend to ChatGPT in the client settings:
settings -> ChatBot -> ChatBot Backend -> ChatGPT
Next, set the OpenAI URL to http://localhost:5000
settings -> ChatBot -> ChatGPT -> OpenAI URL -> http://localhost:5000