MoCA: Motion-Conditioned Image Animation for Video Editing

Wilson Yan^1,2, Andrew Brown¹, Pieter Abbeel², Rohit Girdhar¹, Samaneh Azadi¹

¹GenAI, Meta, ² UC Berkeley

VideoEdit Benchmarking Data

To download the VideoEdit evaluation dataset in a local directory as ${DIR}, run

sudo apt-get update && sudo apt-get install ffmpeg
pip install -r requirements.txt
bash dataset/download_process_all.sh ${DIR}

This dataset includes the motion editing examples we collected from YouTube-8M, as well as filtered examples (excluding human faces and hands due to legal concerns) from Loveu-tgve-2023 data and the Dreamix examples. Please make sure to cite them accordingly.

License

VideoEdit data is released under CC-BY-NC 4.0 license. See License for additional details.