v0.8.3

Per-Request Model Override

Requests can now specify a different backend model via the model field in the request payload.

Added

• Per-Request Model Override - Requests can now specify a different backend model via the model field
  • If request model differs from server's model_name, temporarily overrides BACKEND_MODEL for that request
  • Enables passthrough to LM Studio/Ollama for model selection at request time
  • Original model is restored after request completes (even on errors)
  • Model name now logged in request_started event for debugging

Example

# Uses qwen2.5:7b for this request only, regardless of server's configured model
curl http://localhost:8000/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "qwen2.5:7b",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

Full Changelog: v0.8.2...v0.8.3