Backend

Setup instructions

MongoDB

1. replace the values in .env.example and rename it to .env

2. in the root folder run the following command:

python manage.py runserver

LLM

Two ways:

Local

1. dont
2. see llm/installscripts

Docker

1. In llm/server.py set ISDOCKER = True and change PORT if needed
2. Run the following in an elevated terminal:

docker build -t llm_server ./llm
docker run -it -p 2023:2023 --gpus all llm_server

TODO:

• refactor /llm to latest version of llamaindex
• fix output of zephyr