Code and models of paper. "Content-Aware Unsupervised Deep Homography Estimation"
By Jirong Zhang, Chuan Wang, Shuaicheng Liu, Lanpeng Jia, Jue Wang, Ji Zhou
- 2019.9.12: Repository for "Content-Aware Unsupervised Deep Homography Estimation".
This repository will contains all the required models and scripts for the paper "Content-Aware Unsupervised Deep Homography Estimation".
In this work, we propose an unsupervised approach with a new architecture for content awareness learning. In particular, we learn a content mask to reject outlier regions to mimic the traditional RANSAC procedure. To realize this, we introduce a novel triple loss for the effective optimization. Moreover, instead of comparing intensity values directly, we calculate loss with respect to our learned deep features, which is more effective. In addition, we introduce a comprehensive homography dataset, within which the testing set contains manually labeled ground-truth point matches for the purpose of quantitative comparison. The dataset consisted of 5 categories, including regular(RE), low-texture(LT), low-light(LL), small foreground(SF), and large-foreground(LF) of scenes. We show the advantages of our method over both traditional feature-based approaches and previous deep-based solutions.
| Comparison with previous DNN based methods | Comparison with feature-based methods |
|---|---|
 |
 |
| Input | Ours | SIFT+RANSAC | Unsupervised[1] | Supervised[2] |
|---|---|---|---|---|
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
- Data
- Code
- Requirements
- Usage
- Training
All code is provided for research purposes only and without any warranty. Any commercial use requires our consent. If you use this code or ideas from the paper for your research, please cite our paper:
@article{zhang2019content,
title={Content-Aware Unsupervised Deep Homography Estimation},
author={Zhang, Jirong and Wang, Chuan and Liu, Shuaicheng and Jia, Lanpeng and Wang, Jue and Zhou, Ji},
journal={arXiv preprint arXiv:1909.05983},
year={2019}
}
[1] T. Nguyen, S. W. Chen, S. S. Shivakumar, C. J. Taylor, and V. Kumar. Unsupervised deep homography: A fast and robust homography estimation model. IEEE Robotics and Automation Letters, 3(3):2346–2353, 2018
[2] D. DeTone, T. Malisiewicz, and A. Rabinovich. Deep image homography estimation. arXiv preprint arXiv:1606.03798, 2016
Questions can be left as issues in the repository. We will be happy to answer them.