Skip to content

v1.0.0 — LLM Observer: Initial Public Release

Choose a tag to compare

@Ranjitbehera0034 Ranjitbehera0034 released this 17 Mar 01:37
· 147 commits to main since this release

🚀 LLM Observer is live on npm

Privacy-first, local-only LLM cost tracking for developers.
Your API keys, prompts, and responses never leave your machine.

Install

npx llm-observer start

Proxy starts on port 4000. Dashboard opens at http://localhost:4001.

What's included

Proxy (port 4000)

  • Intercepts and forwards requests to OpenAI, Anthropic, Google Gemini,
    Mistral, Groq, and any local/custom OpenAI-compatible endpoint (Ollama etc.)
  • Token counting and cost calculation for 80+ models across 11 providers
  • Streaming SSE support for all providers
  • Budget guard — blocks requests when daily spend limit is hit
  • Rate limit guard — configurable per-project request throttling
  • Anomaly detection — fires alert when spend spikes 5× rolling average
  • Request tagging via x-llm-observer-tags header

Dashboard (port 4001)

  • Control Room — real-time spend counter, stat cards, 7-day cost trajectory chart
  • Live Traffic — SSE-powered request log with filters by provider, model, status
  • Trace Detail — full request/response inspection, token breakdown, cost per call
  • Cost Optimizer — duplicate prompt detection, model downgrade suggestions
  • Projects — multi-project cost isolation with per-project budgets
  • Alerts — webhook rules for budget thresholds (Slack, Discord, any HTTP)
  • Settings — API key management for all 6 providers

CLI

  • llm-observer start / stop / status
  • llm-observer stats / logs / export
  • llm-observer projects list/create
  • llm-observer budget set
  • llm-observer upgrade (Lemon Squeezy + Razorpay India)
  • llm-observer activate

Database

  • SQLite at ~/.llm-observer/data.db — fully local
  • 84 models pre-seeded with current pricing
  • Versioned migration system
  • 7-day log retention (free tier)

Quick start

Point your OpenAI client at the proxy:

baseURL: 'http://localhost:4000/v1/openai'

Point your Anthropic client:

baseURL: 'http://localhost:4000/v1/anthropic'

Links