Replies: 1 comment 1 reply
-
|
@andreynering Would love to get a quick review and merge this in — it's a clean addition that keeps model list always up-to-date without any maintenance overhead. Happy to address any feedback! |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
What is LLM API?
LLM API is an OpenAI-compatible API gateway that routes
requests to 160+ models across multiple providers (OpenAI, Anthropic, Google,
and others) through a single endpoint:
https://api.llmapi.ai/v1LLMAPI_API_KEY)Why a built-in provider instead of a custom config entry?
LLM API exposes
GET /v1/models(no auth required) with rich metadata permodel: name, context_length, input_modalities (vision), reasoning support.
The list changes frequently as new models are added.
A static config entry in
crush.jsonwould always be outdated. The rightapproach is to fetch the model list dynamically at startup — the same pattern
already used by the Hyper provider.
Proposed implementation
internal/agent/llmapi/— package with constants andBaseURL()internal/config/llmapi.go— sync mechanism that fetches/v1/models,maps the response to
catwalk.Provider(name, context_length,SupportsImages, CanReason), caches the result
openai-compatfantasy provider — no new SDK neededoffline
Implementation
Working proof-of-concept in my fork. Happy to open a PR once there's
approval here.
Beta Was this translation helpful? Give feedback.
All reactions