ai examples

Setup

Pip Install

pip install -r requirements.txt

Initalize DB

Run python .\setup\initSRD.py, first time you run this it will auto-download a smaller AI model to your cache, only needs to be ran once

Setup Model

Pick which llm (AI model) to use, change the import in main.py to use that model

For Vicuna (llm_vicuna7b.py), download and place the model in ../ai-models/vicuna-7B-1.1-HF

For PaLM API (llm_makersuite.py), set your MAKER_KEY in .env

Run main script

python .\main.py