-
Worker : Worker does the heavy lifting. It retrives similar data from vectorDB (Chroma DB)
-
Backend App : Its the app exposing backend API to frontend. It also updates results in redis cache
-
Frontend : Frontend interacts with backend-api and gives back the result
-
Rabbit MQ : Message queue has prompts and results channel through which backend and worker interact with for asynch communication.
-
OpenAI API : We are using 'GPT-3.5-turbo' model and restricting the context with the information retreival done from vector DB
-
Redis : To cache prompts and its result for faster response.
Install following
- Docker
- Node.js
- Python
cd docker
docker-compose up -d cd frontend
npm install
npm start pip install -r requirements.txt python source/worker.py python source/searchDB.pyopen in browser : http://localhost:3000/