SAVE: Spectral-Shift-Aware Adaptation of Image Diffusion Models for Text-guided Video Editing

If you like our project, please give us a star ⭐ on GitHub for the latest update.

Project page | Paper

😮 Highlights

SAVE allows you to edit your video in a matter of 3 minutes! instead of 30 minutes! in SOTA.

💡 Efficient, High-quality, and Fast-speed

• Stable Diffusion (SD) for image generation --> high-quality
• Only fine-tune the Singular Values of the Query Matrices --> Efficient Adaptation

🚩 Updates

Welcome to watch 👀 this repository for the latest updates.

✅ [2023.12.1] : We have released our paper, Free-Editor on arXiv.

✅ [2023.12.1] : Release project page.

• Code release.

🛠️ Methodology

🚀 Video-Editing Results

Qualitative comparison

Quantitative comparison

👍 Acknowledgement

This work is built on many amazing research works and open-source projects, thanks a lot to all the authors for sharing!

• Tune-A-Video
• Stable Diffusion
• Diffusers

✏️ Citation

If you find our paper and code useful in your research, please consider giving a star ⭐ and a citation 📝.

@misc{karim2023save,
      title={SAVE: Spectral-Shift-Aware Adaptation of Image Diffusion Models for Text-driven Video Editing}, 
      author={Nazmul Karim and Umar Khalid and Mohsen Joneidi and Chen Chen and Nazanin Rahnavard},
      year={2023},
      eprint={2305.18670},
      archivePrefix={arXiv},
      primaryClass={cs.CV}
}