LLM Backend with Google Maps Integration - Setup Script

1. Clone the repository (replace with your actual repository URL)

git clone https://github.com/Alvi19/LLM.git cd LLM

2. Create and activate virtual environment

python -m venv venv source venv/bin/activate # On Windows: venv\Scripts\activate

3. Install dependencies

pip install fastapi uvicorn requests python-dotenv gradio ollama

4. Install Ollama and setup model (if not already installed)

For Linux/macOS:

curl -fsSL https://ollama.ai/install.sh | sh

For Windows: Download from https://ollama.ai/download and install manually

5. Pull the required LLM model

ollama pull llama3.2:1b

6. Create environment file for Google API key

echo "GOOGLE_API_KEY=your_google_maps_api_key_here" > .env

7. Start Ollama service (in a new terminal/tab)

ollama serve

8. Run the backend server (in the main terminal)

uvicorn main:app --reload --host 0.0.0.0 --port 8000

9. (Optional) Run the frontend in another terminal

First activate the virtual environment in the new terminal:

cd LLM_BE

source venv/bin/activate

Then run:

python frontend.py