Skip to content
Content-Aware Unsupervised Deep Homography Estimation
Branch: master
Clone or download
Latest commit ebf0e64 Sep 21, 2019
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
images
LICENSE Initial commit Sep 12, 2019
README.md Update README.md Sep 21, 2019

README.md

Code and models of paper. "Content-Aware Unsupervised Deep Homography Estimation"

By Jirong Zhang, Chuan Wang, Shuaicheng Liu, Lanpeng Jia, Jue Wang, Ji Zhou

Update

Introduction

This repository will contains all the required models and scripts for the paper "Content-Aware Unsupervised Deep Homography Estimation".

In this work, we propose an unsupervised approach with a new architecture for content awareness learning. In particular, we learn a content mask to reject outlier regions to mimic the traditional RANSAC procedure. To realize this, we introduce a novel triple loss for the effective optimization. Moreover, instead of comparing intensity values directly, we calculate loss with respect to our learned deep features, which is more effective. In addition, we introduce a comprehensive homography dataset, within which the testing set contains manually labeled ground-truth point matches for the purpose of quantitative comparison. The dataset consisted of 5 categories, including regular(RE), low-texture(LT), low-light(LL), small foreground(SF), and large-foreground(LF) of scenes. We show the advantages of our method over both traditional feature-based approaches and previous deep-based solutions.

Results of Quantitative comparison

Comparison with previous DNN based methods Comparison with feature-based methods

Results of Qualitative comparison

Input Ours SIFT+RANSAC Unsupervised[1] Supervised[2]

TODO

  1. Data
  2. Code
  3. Requirements
  4. Usage
  5. Training

License and Citation

All code is provided for research purposes only and without any warranty. Any commercial use requires our consent. If you use this code or ideas from the paper for your research, please cite our paper:

@article{zhang2019content,
  title={Content-Aware Unsupervised Deep Homography Estimation},
  author={Zhang, Jirong and Wang, Chuan and Liu, Shuaicheng and Jia, Lanpeng and Wang, Jue and Zhou, Ji},
  journal={arXiv preprint arXiv:1909.05983},
  year={2019}
}

References

[1] T. Nguyen, S. W. Chen, S. S. Shivakumar, C. J. Taylor, and V. Kumar. Unsupervised deep homography: A fast and robust homography estimation model. IEEE Robotics and Automation Letters, 3(3):2346–2353, 2018
[2] D. DeTone, T. Malisiewicz, and A. Rabinovich. Deep image homography estimation. arXiv preprint arXiv:1606.03798, 2016

Contact

Questions can be left as issues in the repository. We will be happy to answer them.

You can’t perform that action at this time.