Progress on Frame Interpolation and Extrapolation

A curated list of recent frame-interpolation work and resources.

Contributing

Please feel free to pull requests to add papers.

Table of Contents

• Category
• Papers
  • Frame Interpolation
  • Frame Extrapolation
• Software
• Blogs

Category

Methods	Optical-flow-based	Convolution-based	Synthesis-based	End-to-end	GAN
PBFI	✔️
FIAC		✔️		✔️
FIASC		✔️		✔️
VETOF		✔️		✔️
DFN		✔️
FSCCN		✔️
ULPI
DMGVP	✔️				✔️

Papers

Frame Interpolation

• Phase-Based Frame Interpolation for Video (PBFI)

  • Simone Meyer, Oliver Wang, Henning Zimmer, Max Grosse and Alexander Sorkine-Hornung, CVPR 2015.
  • [Paper] [Third-party code]

• Video Frame Interpolation via Adaptive Convolution (FIAC)

  • Simon Niklaus, Long Mai and Feng Liu, CVPR 2017.
  • [Paper] [Web]

• Video Frame Interpolation via Adaptive Separable Convolution (FIASC)

  • Simon Niklaus, Long Mai and Feng Liu, ICCV 2017.
  • [Paper] [Code] [Web]

• Video Enhancement with Task-Oriented Flow (VETOF)

  • Tianfan Xue, Baian Chen, Jiajun Wu, Donglai Wei and William T. Freeman, Arxiv 2017.
  • [Paper]

Frame Extrapolation

• Dynamic filter networks (DFN)

  • Bert De Brabandere, Xu Jia, Tinne Tuytelaars and Luc Van Gool, NIPS 2016.
  • [Paper] [Code]

• Visual Dynamics: Probabilistic Future Frame Synthesis via Cross Convolutional Networks (FSCCN)

  • Tianfan Xue, Jiajun Wu, Katherine L Bouman and William T Freeman, NIPS 2016
  • [Paper] [Code] [Web]

• Unsupervised learning for physical interaction through video prediction (ULPI)

  • Chelsea Finn, Ian Goodfellow and Sergey Levine, NIPS 2016
  • [Paper]

• Dual Motion GAN for Future-Flow Embedded Video Prediction (DMGVP)

  • Xiaodan Liang, Lisa Lee, Wei Dai and Eric P. Xing, ICCV 2017
  • [Paper]

Software

• Butterflow