v1.0.0 — LLM Observer: Initial Public Release
🚀 LLM Observer is live on npm
Privacy-first, local-only LLM cost tracking for developers.
Your API keys, prompts, and responses never leave your machine.
Install
npx llm-observer start
Proxy starts on port 4000. Dashboard opens at http://localhost:4001.
What's included
Proxy (port 4000)
- Intercepts and forwards requests to OpenAI, Anthropic, Google Gemini,
Mistral, Groq, and any local/custom OpenAI-compatible endpoint (Ollama etc.) - Token counting and cost calculation for 80+ models across 11 providers
- Streaming SSE support for all providers
- Budget guard — blocks requests when daily spend limit is hit
- Rate limit guard — configurable per-project request throttling
- Anomaly detection — fires alert when spend spikes 5× rolling average
- Request tagging via x-llm-observer-tags header
Dashboard (port 4001)
- Control Room — real-time spend counter, stat cards, 7-day cost trajectory chart
- Live Traffic — SSE-powered request log with filters by provider, model, status
- Trace Detail — full request/response inspection, token breakdown, cost per call
- Cost Optimizer — duplicate prompt detection, model downgrade suggestions
- Projects — multi-project cost isolation with per-project budgets
- Alerts — webhook rules for budget thresholds (Slack, Discord, any HTTP)
- Settings — API key management for all 6 providers
CLI
- llm-observer start / stop / status
- llm-observer stats / logs / export
- llm-observer projects list/create
- llm-observer budget set
- llm-observer upgrade (Lemon Squeezy + Razorpay India)
- llm-observer activate
Database
- SQLite at ~/.llm-observer/data.db — fully local
- 84 models pre-seeded with current pricing
- Versioned migration system
- 7-day log retention (free tier)
Quick start
Point your OpenAI client at the proxy:
baseURL: 'http://localhost:4000/v1/openai'
Point your Anthropic client:
baseURL: 'http://localhost:4000/v1/anthropic'