Video Frame Synthesis using Deep Voxel Flow
Switch branches/tags
Nothing to show
Clone or download
Latest commit 70920f2 Nov 3, 2018
Permalink
Failed to load latest commit information.
data_list Initial commit Feb 5, 2018
misc Initial commit Feb 5, 2018
utils Initial commit Feb 5, 2018
.gitattributes Initial commit Feb 5, 2018
.gitignore Initial commit Feb 5, 2018
README.md update readme Nov 3, 2018
dataset.py Initial commit Feb 5, 2018
eval_voxelflow.m update evaluation code Jun 9, 2018
voxel_flow_model.py Initial commit Feb 5, 2018
voxel_flow_train.py Initial commit Feb 5, 2018

README.md

Video Frame Synthesis using Deep Voxel Flow

We address the problem of synthesizing new video frames in an existing video, either in-between existing frames (interpolation), or subsequent to them (extrapolation). Our method requires no human supervision, and any video can be used as training data by dropping, and then learning to predict, existing frames. Deep Voxel Flow (DVF) is efficient, and can be applied at any video resolution. We demonstrate that our method produces results that both quantitatively and qualitatively improve upon the state-of-the-art.

Note: we encourage you to check out the newly released pytorch-voxel-flow. Please contact Dr. Xiaoxiao Li (lxx1991@gmail.com) for the pre-trained models of "Deep Voxel Flow".

[Project] [Paper] [Demo]

Other Implementations

Overview

Deep Voxel Flow (DVF) is the author's re-implementation of the video frame synthesizer described in:
"Video Frame Synthesis using Deep Voxel Flow"
Ziwei Liu, Raymond A. Yeh, Xiaoou Tang, Yiming Liu, Aseem Agarwala (CUHK & UIUC & Google Research) in International Conference on Computer Vision (ICCV) 2017, Oral Presentation

Further information please contact Ziwei Liu.

Requirements

Data Preparation

Getting started

  • Run the training script:
python voxel_flow_train.py --subset=train
  • Run the testing script:
python voxel_flow_train.py --subset=test
  • Run the evaluation script:
matlab eval_voxelflow.m

License and Citation

The use of this software is RESTRICTED to non-commercial research and educational purposes.

@inproceedings{liu2017voxelflow,
 author = {Ziwei Liu, Raymond Yeh, Xiaoou Tang, Yiming Liu, and Aseem Agarwala},
 title = {Video Frame Synthesis using Deep Voxel Flow},
 booktitle = {Proceedings of International Conference on Computer Vision (ICCV)},
 month = {October},
 year = {2017} 
}

Disclaimer

This is not an official Google product.