Installation of Pi-Code and use with local LLM's

This repository contains bash scripts for installing Pi and for running it with local LLM's.

Overview

The bin directory contains the following bash scripts:

bin/
└── download_install.sh

Download and Install

Enter the bin directory and type the following command.

# Command
./download_install.sh

Configuration of local LLM's

Edit the models.json file:

# Edit
~/.pi/agent/models.json

Configure the local LLM's. The id and name values here refer to the config.yaml configuration file in ed_llama-swap

{
    "providers": {
        "llama-cpp": {
            "baseUrl": "http://127.0.0.1:8080/v1",
            "api": "openai-completions",
            "apiKey": "none",
            "models": [
                {
                    "id": "qwen3.6-27b-q4",
                    "name": "qwen3.6-27b-q4",
                    "input": ["text", "image"],
                    "contextWindow": 163840,
                    "maxTokens": 32768,
                    "reasoning": true
                },
                {
                    "id": "qwen3.6-27b-q5",
                    "name": "qwen3.6-27b-q5",
                    "input": ["text", "image"],
                    "contextWindow": 131072,
                    "maxTokens": 32768,
                    "reasoning": true
                },
                {
                    "id": "qwen3.6-35b-a3b-q4",
                    "name": "qwen3.6-35b-a3b-q4",
                    "input": ["text", "image"],
                    "contextWindow": 196608,
                    "maxTokens": 32768,
                    "reasoning": true
                },
                {
                    "id": "qwen3.6-35b-a3b-q5",
                    "name": "qwen3.6-35b-a3b-q5",
                    "input": ["text", "image"],
                    "contextWindow": 114688,
                    "maxTokens": 32768,
                    "reasoning": true
                },
                {
                    "id": "qwen3-vl-30b-a3b-instruct-q4",
                    "name": "qwen3-vl-30b-a3b-instruct-q4",
                    "input": ["text", "image"],
                    "contextWindow": 155648,
                    "maxTokens": 32768,
                    "reasoning": true
                },
                {
                    "id": "qwen3-vl-32b-instruct-q4",
                    "name": "qwen3-vl-32b-instruct-q4",
                    "input": ["text", "image"],
                    "contextWindow": 49152,
                    "maxTokens": 32768,
                    "reasoning": true
                },
                {
                    "id": "gemma-4-12b-it-q8",
                    "name": "gemma-4-12b-it-q8",
                    "input": ["text", "image"],
                    "contextWindow": 131072,
                    "maxTokens": 32768,
                    "reasoning": true
                },
                {
                    "id": "gemma-4-26b-a4b-it-q5",
                    "name": "gemma-4-26b-a4b-it-q5",
                    "input": ["text", "image"],
                    "contextWindow": 196608,
                    "maxTokens": 32768,
                    "reasoning": true
                },
                {
                    "id": "gemma-4-31b-it-q4",
                    "name": "gemma-4-31b-it-q4",
                    "input": ["text", "image"],
                    "contextWindow": 98304,
                    "maxTokens": 32768,
                    "reasoning": true
                }
            ]
        }
    }
}

Links

• https://pi.dev
• https://pi.dev/docs/latest
• https://pi.dev/packages
• https://pi.dev/models

GitHub

• https://github.com/earendil-works/pi