In order to reduce the gap between existing tasks and realistic needs for storyboard creation, we propose a new task called Text synopsis to Video Storyboard (TeViS). In the TeViS task, we aim to retrieve an ordered sequence of images from large-scale movie database as video storyboard to visualize an input text synopsis.
In the TeViS task, we aim to retrieve an ordered sequence of images from large-scale movie database as video storyboard to visualize an input text synopsis. For this purpose, we collect the MovieNet-TeViS benchmark based on the public MovieNet dataset.
The following figure shows how we differ from existing tasks, other datasets.
We will soon release the ablation details and accompanying code. Thank you for your patience.
- ❤️August, 2023: Paper accepted by ACM MM'23.
- ⭐July, 2023: VQ-Trans code was released publicly.
- 😃June, 2023: MovieNet-TeViS dataset was released publicly.