wetllama

Installation

Requires uv

git clone https://github.com/scriptsmith/wetllama.git
cd wetllama
uv tool install -e .
wetllama

Usage

$ wetllama --help
usage: wetllama [-h] {install,start,stop,connect,list,logs,shell,clean} ...

Ollama HPC Client - Run and manage Ollama on an HPC cluster

positional arguments:
  {install,start,stop,connect,list,logs,shell,clean}
                        Command to execute
    install             Install Ollama on the HPC cluster
    start               Start an Ollama server on the HPC cluster
    stop                Stop all running Ollama jobs
    connect             Connect to a running Ollama server
    list                List running Ollama jobs
    logs                Check logs of a running Ollama job
    shell               Get an interactive shell on the compute node
    clean               Clean up old job status entries

options:
  -h, --help            show this help message and exit

Install the Ollama CLI on the HPC cluster:

wetllama install

Start an Ollama server on the HPC cluster:

wetllama start

Connect to a running Ollama server:

wetllama connect

List running Ollama jobs:

wetllama list

Use Ollama CLI commands to interact with the server:

$ ollama list
NAME                 ID              SIZE      MODIFIED     
gemma3:4b            a2af6cc3eb7f    3.3 GB    35 hours ago    
gemma3:27b-it-qat    29eb0b9aeda3    18 GB     35 hours ago    
deepseek-r1:671b     739e1b229ad7    404 GB    3 months ago    
deepseek-r1:1.5b     a42b25d8c10a    1.1 GB    3 months ago    
deepseek-r1:7b       0a8c26691023    4.7 GB    3 months ago    
deepseek-r1:70b      0c1615a8ca32    42 GB     3 months ago
$ ollama run gemma3:4b
[INFO] Starting gemma3:4b
>>> Hello there!
Hi! How can I help you today?

Stop all running Ollama jobs:

wetllama stop

Check logs of a running Ollama job:

wetllama logs