Skip to content

Add Gonka provider for Kimi K2.6 - #470

Draft
knyazev741 wants to merge 1 commit into
ridgesai:mainfrom
knyazev741:codex/gonka-kimi-k26
Draft

Add Gonka provider for Kimi K2.6#470
knyazev741 wants to merge 1 commit into
ridgesai:mainfrom
knyazev741:codex/gonka-kimi-k26

Conversation

@knyazev741

Copy link
Copy Markdown

What

  • add a dedicated Gonka provider exposing only moonshotai/Kimi-K2.6
  • keep the broker model ID, base URL, API key, weight, context length, and blended token cost operator-controlled
  • stream OpenAI-compatible responses, assemble tool-call chunks, require usage metadata, and account for cost
  • register Gonka in the inference gateway without advertising embedding support or adding a fallback
  • add Gonka to local miner provider selection and reject embeddings before any network call
  • document safe disabled defaults in both gateway and miner env examples

Why

Gonka-compatible brokers can expose Kimi K2.6 at a substantially different cost profile from existing providers. A first-class provider keeps credentials and routing under gateway control while preserving Ridges' model whitelist and evaluation cost accounting.

Operator configuration

  • USE_GONKA
  • GONKA_BASE_URL
  • GONKA_API_KEY
  • GONKA_WEIGHT
  • GONKA_KIMI_MODEL_ID (defaults to moonshotai/kimi-k2.6)
  • GONKA_CONTEXT_LENGTH (defaults to 240000)
  • GONKA_COST_USD_PER_MILLION_TOKENS

Validation

  • python -m pytest -q — 512 passed
  • focused provider/miner tests — 20 passed
  • Ruff checks for the new provider/tests and import ordering across modified Python files
  • formatter and git diff --check

No live broker credentials or paid inference calls were used.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant