-
Notifications
You must be signed in to change notification settings - Fork 435
Add video-to-video #1469
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add video-to-video #1469
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
cc: @linoytsaban - since you wanted to open a PR for this!
packages/tasks/src/tasks/index.ts
Outdated
@@ -111,6 +111,7 @@ export type { | |||
} from "./zero-shot-object-detection/inference.js"; | |||
|
|||
import type { ModelLibraryKey } from "../model-libraries.js"; | |||
import { get } from "http"; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
is this supposed to be here?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
idk where it came from lol thx for pointing out, fixed
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good to me! Do we have a list of models where this would already apply?
IIRC @linoytsaban had 10-12 models she was tracking!
@Vaibhavs10 this yields 62 models https://huggingface.co/search/full-text?q=video-to-video&type=model I'll open PRs |
@Vaibhavs10 I opened the PRs, we can merge when some are merged |
merged main to this branch, it broke one test ^_^ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Broken test is unrelated to the PR, let's wait for more than half of PRs to be merged before merging this please.
Excited for this! 🤗
Cool work! |
awesome 🤗 opened PRs for the VACE models too |
Could also be relevant for datasets, e.g. Gemini added it here: https://huggingface.co/datasets/Iceclear/SeedVR_VideoDemos. |
opened PRs for SeedVR. the moon one can't be merged without this one being merged (it will fail) this one errors come from mcp client and not this PR, can someone review and we can merge |
I think node and browser error isn't related to this PR |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
CI errors are unrelated feel free to merge
Adding video-to-video as task for models like following (h/t @NielsRogge)
https://github.com/alonzoleeeooo/stablev2v
https://huggingface.co/spaces/fffiloni/Pix2Pix-Video
https://huggingface.co/chestnutlzj/WF-VAE-L-16Chn
also cc @sayakpaul