🐣 Please follow me for new updates https://twitter.com/camenduru
🔥 Please join our discord server https://discord.gg/k5BwmmvJJU
🥳 Please join my patreon community https://patreon.com/camenduru

🦒 Colab

🚦 WIP 🚦

Colab	Info
	control_a_video_colab

Tutorial

--control_mode', type=str, default='depth', help='support: hed, canny, depth'
--inference_step', type=int, default=20, help='denoising steps for inference'
--guidance_scale', type=float, default=7.5, help='guidance scale'
--seed',  type=int, default=1, help='seed'
--num_sample_frames', type=int, default=8, help='total frames to inference'
--each_sample_frame', type=int, default=8, help='auto-regressive generation for each iteration'
--sampling_rate', type=int, default=3, help='skip sampling from input video'
--height', type=int, default=512, help='ouput height'
--width', type=int, default=512, help='ouput width'
--video_scale', type=float, default=1.5, help='video smoothness scale'
--init_noise_thres', type=float, default=0.1, help='thres for res noise init'
--input_video',type=str, default='bear.mp4'
--prompt',type=str, default="a bear walking through stars, artstation"

Main Repo

https://github.com/Weifeng-Chen/control-a-video

Paper

https://arxiv.org/abs/2305.13840

Page

https://controlavideo.github.io/

Output

input bear.mp4

a bear walking through stars, artstation.