Skip to content

v0.11.0

Choose a tag to compare

@assareh assareh released this 10 Dec 04:24
· 15 commits to main since this release

Added

  • Request Hook - Configurable callback for debugging/logging LLM requests
    • New REQUEST_HOOK config option: Callable[[str, dict], None] | None
    • Called with (backend_name, payload) before each request to Ollama or LM Studio
    • Enables request logging, debugging, and monitoring without monkey-patching

Example usage

def log_request(backend: str, payload: dict):
    print(f"[{backend}] {json.dumps(payload)}")

config.REQUEST_HOOK = log_request