AI Private GPT Installation

Reference: PrivateGPT4Linux

Use git to download the PrivateGPT

• git clone https://github.com/imartinez/privateGPT
• sudo pacman -S pyenv
• pyenv install 3.11
• pyenv local 3.11

Running ollama on background

• nohup env OLLAMA_HOST=0.0.0.0:11434 ollama serve &

Adding basic model

• ollama pull mistral
• ollama pull nomic-embed-text

Installing PrivateGPT dependencies

• poetry install --extras "ui llms-ollama embeddings-ollama vector-stores-qdrant"

Running

• PGPT_PROFILES=ollama make run