Semantic Search and RAG-ish application for LDS Scriptures
Stack: LitServe (by Lightning.AI) Qdrant Llama-3.1 (through Ollama)
Recommendation: Use uv!
Create venv:
uv venv
Install prereqs
uv pip install -r requirements.txt
Create docker images:
docker compose -f vectordb_llm_server/docker-compose.yml up -d
Set url:
export LDS_RAG_URL="http://127.0.0.1:8000"
Run the server
python src/server.py
With the server running, run the client:
python src/scripture_client.py