chatllm

To run this code, you need a GPU at least with 8GB Graphics Memory

First sync dependencies and run the server

rye sync
rye run python openai_api.py

Then create a new shell process, and run the following

rye run python chain.py