feat(provider/xai): add video extension and reference-to-video (R2V) support#13887
Merged
felixarntz merged 3 commits intovercel:mainfrom Apr 2, 2026
Merged
Conversation
tigent
bot
added
ai/provider
![vercel[bot]](https://avatars.githubusercontent.com/in/8329?s=60&v=4){kind=small}
Jaaneek
force-pushed
the
feat/xai-video-extension-r2v
branch
2 times, most recently
from
609acb7 to
964ce85
Compare
felixarntz
reviewed
Mar 30, 2026
Jaaneek
force-pushed
the
feat/xai-video-extension-r2v
branch
3 times, most recently
from
71cfb3a to
15e8fe0
Compare
Jaaneek
commented
Apr 1, 2026
felixarntz
reviewed
Apr 2, 2026
Collaborator
felixarntz
left a comment
felixarntz
left a comment
There was a problem hiding this comment.
@Jaaneek This looks great! almost good to go, just running into one problem with the video editing example.
| | XaiLegacyEditVideoOptions | ||
| | XaiLegacyReferenceToVideoOptions; | ||
|
|
||
| export interface XaiParsedVideoModelOptions extends XaiVideoSharedOptions { |
Collaborator
There was a problem hiding this comment.
Not sure about the name of this one. Isn't it rather the "unparsed" version? if I understand correctly, this only exists for back compat, i.e. legacy, or not? If so, maybe call it XaiLegacyVideoModelOptions and mark it as deprecated?
This way people don't have to switch right away, but they'd be encouraged to update their providerOptions usage to rely on XaiVideoModelOptions soon.
…support feat(provider/xai): add explicit video modes
Jaaneek
force-pushed
the
feat/xai-video-extension-r2v
branch
from
15e8fe0 to
109d4b0
Compare
felixarntz
approved these changes
Apr 2, 2026
Collaborator
felixarntz
left a comment
felixarntz
left a comment
There was a problem hiding this comment.
@Jaaneek Thanks, everything working great now. Good to merge, and then I'll backport to v6!
felixarntz
added
the
backport
vercel-ai-sdk
bot
removed
the
backport
Contributor
|
|
felixarntz
added a commit
that referenced
this pull request
Apr 2, 2026
…deo (R2V) support (#14079) This is an automated backport of #13887 to the release-v6.0 branch. FYI @Jaaneek ~~This backport has conflicts that need to be resolved manually.~~ Conflicts resolved. ### `git cherry-pick` output ``` Auto-merging content/providers/01-ai-sdk-providers/01-xai.mdx Auto-merging packages/xai/src/xai-video-model.test.ts Auto-merging packages/xai/src/xai-video-model.ts CONFLICT (content): Merge conflict in packages/xai/src/xai-video-model.ts error: could not apply f51c95e... feat(provider/xai): add video extension and reference-to-video (R2V) support (#13887) hint: After resolving the conflicts, mark them with hint: "git add/rm <pathspec>", then run hint: "git cherry-pick --continue". hint: You can instead skip this commit with "git cherry-pick --skip". hint: To abort and get back to the state before "git cherry-pick", hint: run "git cherry-pick --abort". hint: Disable this message with "git config set advice.mergeConflict false" ``` --------- Co-authored-by: Jaaneek <25470423+Jaaneek@users.noreply.github.com> Co-authored-by: Felix Arntz <felix.arntz@vercel.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Background
The xAI video API supports five generation modes, but the SDK only implemented three (text-to-video, image-to-video, editing). Video extension (
POST /v1/videos/extensions) and reference-to-video/R2V (POST /v1/videos/generationswithreference_images) were missing. The xAI provider docs were also outdated, still referencinggrok-4-fast-non-reasoningand missinggrok-4.20models,grok-imagine-image-pro, and the new video modes.Summary
Provider (
@ai-sdk/xai):extensionUrlprovider option →POST /v1/videos/extensionsreferenceImageUrlsprovider option (1–7 images) →POST /v1/videos/generations.progressfield in provider metadataerrorto response schema (defensive)prompt: options.prompt ?? ''for image-to-video without textDocumentation:
extensionUrlandreferenceImageUrlsprovider optionsgrok-imagine-image-prowithresolution(1k/2k) andqualityoptionsgrok-4.20-reasoning/grok-4.20-non-reasoning{ videos }to{ video }(singular). I feel like this is better since xAI does not allow multiple videos generation but let me know.Examples:
extend.ts,extend-warnings.ts,reference-images.tsbasic.ts,edit-concurrent.ts,edit-warnings.tswith null-safe metadata access and{ video }patternTests: 62 total (up from ~25), covering all new modes, validation, edge cases, polling, and metadata.
Checklist
pnpm changesetin the project root)Future Work
error.messagefrom API infailedstatus handler (xAI doesn't document this field yet)urlproperty to coreGeneratedFileto avoidproviderMetadatadance for chaining