LLM Integration Plugin Template

LLM Integration Plugin Template is a repository that provides a template for creation of plugins accessing LLMs from IntelliJ-based IDEs.

Table of contents

• Getting started

OpenAI

• Sign up for OpenAI at https://beta.openai.com/signup
• Get your OpenAI API key
• Go to Settings | Tools | Large Language Models and enter your API key in the "OpenAI Key" field. If you are a member of only one organization, leave the "OpenAI Organization" field empty

Gemini

• Sign up for OpenAI at https://aistudio.google.com/apikey
• Get your Gemini API key
• Go to Settings | Tools | Large Language Models and enter your API key in the "Gemini Key" field.

Ollama

What is Ollama?

Ollama is a lightweight framework for running large language models (LLMs) locally on your machine. It allows you to download, run, and customize various open-source models like Llama 3.2, deepseek-r1 and many others.

System Requirements

• Memory: At least 8GB RAM for 7B parameter models, 16GB for 13B models, and 32GB+ for larger models
• Storage: Varies by model (1.3GB-400GB+ depending on model size)
• GPU: Optional but recommended for better performance
  • NVIDIA GPU with CUDA support
  • AMD GPU with ROCm support (Linux only)
  • Apple Silicon (built-in Metal acceleration)

Installation

macOS

# Download and install
curl -fsSL https://ollama.com/download/Ollama-darwin.zip -o Ollama-darwin.zip
unzip Ollama-darwin.zip
mv Ollama.app /Applications/

# Or use the one-click installer from https://ollama.com/download

Windows

# Download and run the installer from
# https://ollama.com/download/OllamaSetup.exe

Linux

# Quick install
curl -fsSL https://ollama.com/install.sh | sh

# Manual install for x86_64
curl -L https://ollama.com/download/ollama-linux-amd64.tgz -o ollama-linux-amd64.tgz
sudo tar -C /usr -xzf ollama-linux-amd64.tgz

# Manual install for ARM64
curl -L https://ollama.com/download/ollama-linux-arm64.tgz -o ollama-linux-arm64.tgz
sudo tar -C /usr -xzf ollama-linux-arm64.tgz

# For AMD GPU support, also install:
curl -L https://ollama.com/download/ollama-linux-amd64-rocm.tgz -o ollama-linux-amd64-rocm.tgz
sudo tar -C /usr -xzf ollama-linux-amd64-rocm.tgz

Docker

# Pull the official Ollama image
docker pull ollama/ollama

# Run Ollama container
docker run -d -v ollama:/root/.ollama -p 11434:11434 --name ollama ollama/ollama

Starting the Ollama Server

macOS/Windows

1. Launch the Ollama application
2. The server will start automatically (default address: localhost:11434)

Linux/Manual Start

# Start the Ollama server
ollama serve

Run as a Systemd Service (Linux)

Create a user and group for Ollama:

sudo useradd -r -s /bin/false -U -m -d /usr/share/ollama ollama
sudo usermod -a -G ollama $(whoami)

Create a service file at /etc/systemd/system/ollama.service:

[Unit]
Description=Ollama Service
After=network-online.target

[Service]
ExecStart=/usr/bin/ollama serve
User=ollama
Group=ollama
Restart=always
RestartSec=3
Environment="PATH=$PATH"

[Install]
WantedBy=default.target

Enable and start the service:

sudo systemctl daemon-reload
sudo systemctl enable ollama
sudo systemctl start ollama

Using Ollama

Pull a Model

ollama pull llama3.2

Run a Model

ollama run llama3.2

Chat with Multimodal Models

ollama run llama3.2-vision "What's in this image? /path/to/image.jpg"

List Available Models

ollama list

View Currently Running Models

ollama ps

Stop a Running Model

ollama stop <model-name>

Updating Ollama

Linux

curl -fsSL https://ollama.com/install.sh | sh

macOS/Windows

Update to the latest version from the Ollama website.

Troubleshooting

• GPU not detected: Ensure proper drivers are installed
  • NVIDIA: Check with nvidia-smi
  • AMD: Verify ROCm installation
• Memory errors: Try a smaller model or increase system swap
• Port conflicts: Change the port with OLLAMA_HOST environment variable

Resources

• Official Documentation
• Model Library
• API Documentation
• Community Discord
• Reddit Community