Skip to content

v0.2.0 - bring your own LLM + history-grounded drafts

Choose a tag to compare

@xbirimensah xbirimensah released this 06 Jul 17:55
· 16 commits to main since this release

The autoreply sidecar no longer assumes Claude Code or an external notes source. Bring any LLM, and drafts ground themselves in your own WhatsApp history out of the box.

Bring your own LLM

AUTOREPLY_LLM_PROVIDER selects the backend for draft generation:

  • claude-cli (default) - the local claude CLI, no API key needed
  • anthropic - Anthropic Messages API via the official SDK (AUTOREPLY_LLM_API_KEY or ANTHROPIC_API_KEY)
  • openai - ANY OpenAI-compatible chat-completions endpoint: OpenAI, OpenRouter, Groq, Mistral, and local runtimes like Ollama or LM Studio (AUTOREPLY_LLM_BASE_URL + AUTOREPLY_LLM_MODEL; key optional for local endpoints)

Drafts grounded in your own message history

  • Reference context from WhatsApp history: each draft now sees the recent conversation with that chat plus keyword matches across all stored messages - no external "second brain" required
  • Style corpus auto-build: if no style corpus exists when the first draft is generated, one is built automatically from your own sent messages
  • npm run autoreply:build-corpus no longer fails without a notes source - it falls back to a WhatsApp-only corpus

Config

# example: OpenRouter
AUTOREPLY_LLM_PROVIDER=openai
AUTOREPLY_LLM_BASE_URL=https://openrouter.ai/api/v1
AUTOREPLY_LLM_API_KEY=sk-or-...
AUTOREPLY_LLM_MODEL=anthropic/claude-sonnet-4.6

Full reference: docs/autoreply.md