Video Instruct‐pix2pix

⚠️ This module requires at least 16GB RAM ⚠️

Informations

• Module : Video Instruct-Pix2Pix
• Function : Edit an input video with instructions from a prompt and a negative prompt using Instructpix2pix and Text2Video-Zero
• Input(s) : Input video, prompt, negative prompt
• Output(s) : Video(s)
• HF model page :
  • timbrooks/instruct-pix2pix

Help

• Usage :
  • Upload or import a video using the Input video field
  • Fill the prompt with the instructions for modifying your input video
  • Fill the negative prompt with what you DO NOT want to see in your output video
  • (optional) Modify the settings to change the number of frames to process (default=8) or the fps of the output
  • Click the Generate button
  • After generation, generated video is displayed in the Generated video field.
• Examples : Instructpix2pix : Learning to Follow Image Editing Instructions

Examples

• Input video :

text2video-zero.webm

• Prompt : turn into a medieval painting
• Negative prompt : bad quality, blurry, ugly
• Output(s) :

vid2vid_ze.webm