feat (provider/bytedance): add Seedream image model support by shaper · Pull Request #17121 · vercel/ai

shaper · 2026-07-12T01:25:56Z

Summary

Adds a ByteDance Seedream image model to @ai-sdk/bytedance, exposed via .image() / .imageModel(). Previously the provider only supported video and threw NoSuchModelError for image models.

The gateway serves ByteDance images through @ai-sdk/openai-compatible, whose image model routes edits to a multipart /images/edits endpoint. ByteDance ARK has no such endpoint — text-to-image and image-to-image both use a single JSON POST /images/generations, with input images passed in the image field (string or array). Routing edits to /images/edits produced non-JSON responses ("Invalid JSON response"). This model implements the correct ARK shape.

Changes

bytedance-image-model.ts — ImageModelV4 using ARK's single JSON /images/generations; input images (single or multi) go in the image field via convertImageModelFileToDataUri (URLs pass through, binary/base64 → data URI). response_format pinned to b64_json.
bytedance-image-model-options.ts — typed ByteDanceImageModelOptions (looseObject schema, mirroring the video model): watermark, outputFormat, size (resolution level), sequentialImageGeneration, maxImages, optimizePromptMode; camelCase → ARK snake_case with passthrough for unknown fields.
bytedance-image-settings.ts — ByteDanceImageModelId (known Seedream ids + open string for ep-… endpoints).
Wired image / imageModel into the provider; exported new types from index.ts.
Tests — generate, edit (single / multi / URL), typed-option mapping, resolution-level size override, unknown-option passthrough, unsupported-setting warnings (aspectRatio, seed, n, mask).
Docs — new Image Models section in 85-bytedance.mdx (text-to-image, edit, multi-image blending, options table, capabilities table) + link to the ModelArk image generation API.
Examples — generate-image/bytedance/{basic,edit,edit-multi-reference}.ts.
Changeset: @ai-sdk/bytedance minor.

Verification

tsc --noEmit: clean (package + examples)
vitest run (package): all tests pass
pnpm build: success

Unsupported inputs warn rather than break: aspectRatio (→ use size), seed, n>1 (→ sequentialImageGeneration), and mask (Seedream has no mask-based inpainting).

Linear: AIG-145 (https://linear.app/vercel/issue/AIG-145)

Add a ByteDance Seedream image model to @ai-sdk/bytedance, exposed via `.image()` / `.imageModel()`. Uses ByteDance ARK's single JSON `/images/generations` endpoint for both text-to-image and image-to-image (input images passed in the `image` field), rather than an OpenAI-style multipart `/images/edits` endpoint. - Typed provider options (`ByteDanceImageModelOptions`) mapping camelCase keys to ARK request fields, with passthrough for unknown fields. - Unit tests covering generate, edit (single/multi/URL), option mapping, and unsupported-setting warnings. - Provider docs: add Image Models section with basic + edit examples and link the ModelArk image generation API. - Example scripts under examples/ai-functions/generate-image/bytedance. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

Add a Seedream multi-reference image edit example following the black-forest-labs edit-multi-reference example for inputs/prompt. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

…xample Pass comic-cat.png + comic-dog.png as file bytes instead of remote URLs. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

…mage docs The AI SDK abstracts the transport; remove references to the request endpoint and the b64_json response format from the image model docs. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

shaper · 2026-07-12T01:31:41Z

+  maxImages?: number | null;
+
+  /**
+   * Prompt optimization mode. `seedream-4-0` supports both `'standard'` and
+   * `'fast'`; other models support `'standard'` only.
+   */
+  optimizePromptMode?: 'standard' | 'fast' | null;


Design decision — flat vs. nested provider options (feedback wanted)

I flattened ByteDance's two nested request objects into single camelCase options:

maxImages → sequential_image_generation_options.max_images

optimizePromptMode → optimize_prompt_options.mode

The model reassembles the nested ModelArk shape before sending.

Why flat: cleaner typed surface, and today each nested object has exactly one documented field, so a nested option would just be a one-key wrapper.

Trade-off: if ByteDance adds more fields under either object later, a flat API needs a new top-level option each time, whereas mirroring ARK 1:1 (sequentialImageGenerationOptions: { maxImages }, optimizePromptOptions: { mode }) would extend naturally and read closer to the API docs.

Preference on flat vs. nested here? Happy to switch before merge.

@felixarntz for any steering, I figure we can do flattened for now and switch to sub-objects if warranted later (and be backwards compatible).

…abilities table Seedream 5.0 Lite's primary id is `seedream-5-0-260128`; ByteDance's docs list `seedream-5-0-lite-260128` as an additional id for the same model. Addresses PR review bot flag. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

kkdawkins

Ship it!

…am-image-model

The API has no output-count parameter, so maxImagesPerCall = 10 made generateImage({ n: 2 }) issue a single call that returned one image. Set it to 1 so generateImage fans n out into n single-image calls, and drop the now-misleading `n` unsupported warning. Batches of related images remain available via the sequentialImageGeneration option. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

github-actions · 2026-07-14T05:03:45Z

⚠️ Backport to release-v6.0 created but has conflicts: #17189

The cherry-picked PR targeted V4 provider specs, which don't exist on release-v6.0. Adapt the Seedream image model to V3: - bytedance-provider.ts / index.ts: keep ProviderV3 / Experimental_VideoModelV3 and the existing ByteDanceVideoProviderOptions export; add image support via ImageModelV3. - bytedance-image-model.ts + test: ImageModelV4 -> ImageModelV3, SharedV4Warning -> SharedV3Warning, specificationVersion 'v4' -> 'v3'. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

@shaper

…#17189) This is an automated backport of #17121 to the release-v6.0 branch. FYI @shaper This backport has conflicts that need to be resolved manually. ### `git cherry-pick` output ``` Auto-merging content/providers/01-ai-sdk-providers/85-bytedance.mdx Auto-merging packages/bytedance/src/bytedance-provider.ts CONFLICT (content): Merge conflict in packages/bytedance/src/bytedance-provider.ts Auto-merging packages/bytedance/src/index.ts CONFLICT (content): Merge conflict in packages/bytedance/src/index.ts error: could not apply 7fd7dab... feat (provider/bytedance): add Seedream image model support (#17121) hint: After resolving the conflicts, mark them with hint: "git add/rm <pathspec>", then run hint: "git cherry-pick --continue". hint: You can instead skip this commit with "git cherry-pick --skip". hint: To abort and get back to the state before "git cherry-pick", hint: run "git cherry-pick --abort". hint: Disable this message with "git config set advice.mergeConflict false" ``` --------- Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: Walter Korman <shaper@vercel.com> Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

github-actions · 2026-07-14T05:41:35Z

🚀 Published in:

Package	Version
`@ai-sdk/bytedance`	2.0.11 github npm
`@ai-sdk/harness-claude-code`	1.0.32 github npm

shaper and others added 2 commits July 11, 2026 18:23

docs (provider/bytedance): add multi-image edit example

5752c39

Add a Seedream multi-reference image edit example following the black-forest-labs edit-multi-reference example for inputs/prompt. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

github-actions Bot assigned shaper Jul 12, 2026

vercel Bot deployed to Preview July 12, 2026 01:27 View deployment

docs (provider/bytedance): use local file bytes in multi-image edit e…

fa3b145

…xample Pass comic-cat.png + comic-dog.png as file bytes instead of remote URLs. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

vercel Bot deployed to Preview July 12, 2026 01:29 View deployment

shaper commented Jul 12, 2026

View reviewed changes

vercel Bot deployed to Preview July 12, 2026 01:32 View deployment

vercel Bot reviewed Jul 12, 2026

View reviewed changes

Comment thread content/providers/01-ai-sdk-providers/85-bytedance.mdx Outdated

shaper added 2 commits July 11, 2026 18:34

rm comments

b606d20

fmt

6aa9e09

vercel Bot deployed to Preview July 12, 2026 01:36 View deployment

shaper requested a review from jeremyphilemon July 12, 2026 01:41

vercel Bot deployed to Preview July 12, 2026 01:41 View deployment

chore (provider/bytedance): mark changeset as patch

6bba1fe

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

shaper added the backport Admins only: add this label to a pull request in order to backport it to the prior version label Jul 12, 2026

vercel Bot deployed to Preview July 12, 2026 01:43 View deployment

kkdawkins approved these changes Jul 13, 2026

View reviewed changes

kkdawkins reviewed Jul 13, 2026

View reviewed changes

Comment thread packages/bytedance/src/bytedance-image-model.ts

shaper and others added 2 commits July 13, 2026 21:51

Merge remote-tracking branch 'origin/main' into feat/bytedance-seedre…

dc96711

…am-image-model

shaper enabled auto-merge (squash) July 14, 2026 04:54

vercel Bot deployed to Preview July 14, 2026 04:55 View deployment

shaper merged commit 7fd7dab into main Jul 14, 2026
49 checks passed

shaper deleted the feat/bytedance-seedream-image-model branch July 14, 2026 05:02

github-actions Bot added a commit that referenced this pull request Jul 14, 2026

Backport conflicts for PR #17121 to release-v6.0

8ff45ba

github-actions Bot mentioned this pull request Jul 14, 2026

Backport: feat (provider/bytedance): add Seedream image model support #17189

Merged

github-actions Bot removed the backport Admins only: add this label to a pull request in order to backport it to the prior version label Jul 14, 2026

lgrammel added the task-merge-tracking-no-issue label Jul 14, 2026

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

feat (provider/bytedance): add Seedream image model support - #17121

feat (provider/bytedance): add Seedream image model support#17121
shaper merged 10 commits into
mainfrom
feat/bytedance-seedream-image-model

shaper commented Jul 12, 2026 •

edited

Loading

Uh oh!

shaper Jul 12, 2026 •

edited

Loading

Uh oh!

Uh oh!

kkdawkins left a comment

Uh oh!

Uh oh!

Uh oh!

github-actions Bot commented Jul 14, 2026

Uh oh!

github-actions Bot commented Jul 14, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Uh oh!

Conversation

shaper commented Jul 12, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Changes

Verification

Uh oh!

shaper Jul 12, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

kkdawkins left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

github-actions Bot commented Jul 14, 2026

Uh oh!

github-actions Bot commented Jul 14, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

shaper commented Jul 12, 2026 •

edited

Loading

shaper Jul 12, 2026 •

edited

Loading