Skip to content

feat: wire LiteLLM provider into CLI and embeddings #208

@decko

Description

@decko

Summary

Wire the LiteLLM adapter (from #103) into the CLI and handle embeddings provider dispatch.

Scope (Part 2 of 2)

  1. Add litellm to --judge-provider CLI choices
  2. Handle embeddings dispatch — keep VertexAIEmbeddings for Vertex, add provider-aware dispatch for LiteLLM models
  3. Update --judge-provider help text with examples
  4. Add CLI integration tests
  5. Update docs (README, getting-started) with per-provider examples

Usage

# Gemini on Vertex AI
raki run --judge --judge-provider litellm --judge-model vertex_ai/gemini-2.5-pro

# OpenAI
raki run --judge --judge-provider litellm --judge-model gpt-4o

# Any LiteLLM-supported model
raki run --judge --judge-provider litellm --judge-model groq/llama-3.1-70b

Files

Depends on

#103 (LiteLLM adapter) must ship first.

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions