Skip to content

Add an Ollama / local-LLM provider #2

@Cyberfilo

Description

@Cyberfilo

Add a third provider alongside Anthropic/OpenAI in src/promptquery/llm.py that talks to a local Ollama server (OpenAI-compatible endpoint). Wire it into make_client (e.g. --model ollama/llama3). Lets people run PromptQuery with no API key and no data leaving the box — a frequently-requested fit for this tool.

Scope: llm.py (new client + factory branch), a README note.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions