cyber-orakel

Erfahre deine Zukunft per Cyber-Keks.

This is a local-only project to generate cyber-style fortune cookie messages using a small LLM and a primitive web-based UI.

Ideally, you follow our example and deploy it on a RaspberryPi with a connected thermo printer.

Preview of the final project

Blog post about the project: https://casualcoding.com/building-a-cyber-oracle-using-a-local-llm-on-a-raspberry-pi-5/

Setup

Install Ollama (needed for running a local LLM)

• https://ollama.com/download/

Fetch the following LLM. It's small and should run on current local machines all the way down to a Raspberry Pi 5.

ollama pull qwen2.5:1.5b

# optional: try if the model runs properly
ollama run qwen2.5:1.5b

python3 -m venv venv
source venv/bin/activate
pip install -r requirements.txt

Run

Without printer support:

python main.py --no-printer

With printer support:

python main.py

Then open your browser and go to http://localhost:8000/

Raspberry Pi setup

Setup

Modify ssh config:

code .ssh/config

add:

Host cyberorakel
  User pablo
  HostName pablopi.local

Run

ssh cyberorakel
source orakel/bin/activate
cd cyberorakel/
python3 print.py "Die digitale Schlacht wird schwer fallen."

Look into kiosk-mode.txt to use chromium in full kiosk mode:

chromium-browser --kiosk URL --noerrdialogs --disable-infobars