Skip to content
A Lightweight Optical Flow CNN - Revisiting Data Fidelity and Regularization, submitted to TPAMI, 2019
Branch: master
Clone or download
Latest commit 9a9182d Apr 14, 2019
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
README.md Added a table Apr 14, 2019

README.md

LiteFlowNet2

This repository (https://github.com/twhui/LiteFlowNet2) is the offical release of LiteFlowNet2 for my paper A Lightweight Optical Flow CNN - Revisiting Data Fidelity and Regularization.

LiteFlowNet2, another lightweight convolutional network, is evolved from our earlier work in CVPR 2018 (https://github.com/twhui/LiteFlowNet) to better address the problem of optical flow estimation by improving flow accuracy and computation time. Comparing to our earlier work, LiteFlowNet2 improves the optical flow accuracy on Sintel clean pass by 24%, Sintel final pass by 8.9%, KITTI 2012 by 16.8%, and KITTI 2015 by 17.5%. Its runtime is 2.2 times faster!

Sintel Clean Testing Set Sintel Final Testing Set KITTI12 Testing Set (Out-Noc) KITTI15 Testing Set (Fl-fg / Fl-all) Model Size (M) Runtime* (ms) GTX 1080
FlowNet2 (CVPR17) 4.16 5.74 4.82% 8.75% / 10.41% 162 121
PWC-Net+ 3.45 4.60 3.36% 7.88% / 7.72% 8.75 40
LiteFlowNet2 3.45 4.90 2.72% 7.20% / 7.74% 6.42 40

Note: *Runtime is averaged over 100 runs for a Sintel's image pair of size 1024 × 436.

License and Citation 

All code and other materials (including but not limited to the paper, figures, and tables) are provided for research purposes only and without any warranty. Any commercial use requires our consent. When using any parts of the code package or the paper (A Lightweight Optical Flow CNN - Revisiting Data Fidelity and Regularization) in your work, please cite the following paper:

@InProceedings{hui19liteflownet2,    
 author = {Tak-Wai Hui and Xiaoou Tang and Chen Change Loy},    
 title = {A {L}ightweight {O}ptical {F}low {CNN} - {R}evisiting {D}ata {F}idelity and {R}egularization}, 
 journal = {arXiv preprint arXiv:1903.07414},
 year = {2019},    
 url = {http://mmlab.ie.cuhk.edu.hk/projects/LiteFlowNet/} 
}

We will release the trained models and codes soon.

You can’t perform that action at this time.