Skip to content

Add ByteDance model support#66

Merged
adambalogh merged 6 commits intomainfrom
aba/bytedance
May 4, 2026
Merged

Add ByteDance model support#66
adambalogh merged 6 commits intomainfrom
aba/bytedance

Conversation

@adambalogh
Copy link
Copy Markdown
Contributor

@adambalogh adambalogh commented May 1, 2026

Adds seed models

TODO:

  • Enable model service in Ark Console

Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adds ByteDance/BytePlus ModelArk (OpenAI-compatible) “Seed” model support to the gateway so requests can be routed/priced like existing OpenAI/Anthropic/Google/xAI models.

Changes:

  • Register Seed models in the model registry (pricing + aliases).
  • Add a new bytedance_api_key to runtime config and wire up a dedicated httpx.Client + routing branch in llm_backend.
  • Document the new provider and add a small local smoke-test script.

Reviewed changes

Copilot reviewed 6 out of 6 changed files in this pull request and generated 3 comments.

Show a summary per file
File Description
tee_gateway/model_registry.py Adds Seed model configs and aliases so the gateway can resolve/prices these model names.
tee_gateway/llm_backend.py Introduces ByteDance routing via ChatOpenAI against a ModelArk base URL with a dedicated shared HTTP client.
tee_gateway/config.py Extends ProviderConfig with bytedance_api_key.
tee_gateway/__main__.py Accepts/logs bytedance_api_key during /v1/keys injection and includes it in the initialized-providers list.
scripts/test_bytedance.py Adds a small local smoke-test to instantiate and invoke a Seed model.
CLAUDE.md Documents the new API key env var and supported model prefixes.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread CLAUDE.md
Comment thread scripts/test_bytedance.py
Comment thread tee_gateway/model_registry.py
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 10 out of 10 changed files in this pull request and generated 1 comment.


💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread README.md
@adambalogh adambalogh merged commit 59b98e5 into main May 4, 2026
7 of 8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants