Skip to content

A curated list of awesome gaze estimation frameworks, datasets and other awesomeness.

License

Notifications You must be signed in to change notification settings

WuZhuoran/awesome-gaze

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

22 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Awesome Gaze

A curated list of awesome gaze estimation papers, codes, datasets and other awesomeness.

Table of Content

Review Papers

  • Mohamed Khamis, Florian Alt, Andreas Bulling. The Past, Present, and Future of Gaze-enabled Handheld Mobile Devices: Survey and Lessons Learned PDF

  • Anuradha Kar and Peter Corcoran. A Review and Analysis of Eye-Gaze Estimation Systems, Algorithms and Performance Evaluation Methods in Consumer Platforms PDF

  • kshay A Gawande, Gangotri Nathaney. A Survey on Gaze Estimation Techniques in Smartphone PDF

  • Xiaomeng Wang, Kang Liu, Xu Qian. A Survey on Gaze Estimation PDF

  • M. V. Sireesha, P. A. Vijaya, K. Chellamma. A Survey on Gaze Estimation Techniques PDF

  • D.W. Hansen, Qiang Ji. In the Eye of the Beholder: A Survey of Models for Eyes and Gaze PDF

  • Abdallahi Ould, Mohamed Matthieu, Perreira Da Silva, Vincent Courboulay. A history of eye gaze tracking PDF

  • Carlos H. Morimoto, Marcio R.M. Mimica. Eye gaze tracking techniques for interactive applications PDF

Journal Papers

Conference Papers

AAAI 2019

  • Dongze Lian, Ziheng Zhang, Weixin Luo, Lina Hu, Minye Wu, Zechao Li, Jingyi Yu, Shenghua Gao. RGBD Based Gaze Estimation via Multi-Task CNN PDF Code

ECCV 2019

  • Petr Kellnhofer, Adria Recasens, Simon Stent, Wojciech Matusik, Antonio Torralba. Gaze360: Physically Unconstrained Gaze Estimation in the Wild PDF Code

  • Seonwook Park, Shalini De Mello, Pavlo Molchanov, Umar Iqbal, Otmar Hilliges, Jan Kautz. Few-Shot Adaptive Gaze Estimation PDF Code

CVPR 2019

  • Yunyang Xiong, Hyunwoo J. Kim, Vikas Singh. Mixed Effects Convolutional Neural Networks (MeNets) with Applications to Gaze Estimation PDF

  • Yu Yu, Gang Liu, Jean-Marc Odobez. Improving User-Specific Gaze Estimation via Gaze Redirection Synthesis PDF

  • Kang Wang, Hui Su, Qiang Ji. Neuro-inspired Eye Tracking with Eye Movement Dynamics PDF

  • Kang Wang, Rui Zhao, Hui Su, Qiang Ji. Generalizing Eye Tracking with Bayesian Adversarial Learning PDF

CVPR 2018

  • Brian Dolhansky, Cristian Canton Ferrer. Eye In-Painting with Exemplar Generative Adversarial Networks PDF Code

  • Yanyu Xu, Yanbing Dong, Junru Wu, Zhengzhong Sun, Zhiru Shi, Jingyi Yu, Shenghua Gao. Gaze Prediction in Dynamic 360° Immersive Videos PDF Code

  • Kang Wang, Rui Zhao, Qiang Ji. A Hierarchical Generative Model for Eye Image Synthesis and Eye Gaze Estimation PDF

  • Arun Balajee Vasudevan, Dengxin Dai, Luc Van Gool. Object Referring in Videos with Language and Human Gaze PDF Code

  • Fan, Lifeng and Chen, Yixin and Wei, Ping and Wang, Wenguan and Zhu, Song-Chun. Inferring Shared Attention in Social Scene Videos PDF

  • Ping Wei, Yang Liu, Tianmin Shu, Nanning Zheng, Song-Chun Zhu. Where and Why Are They Looking? Jointly Inferring Human Attention and Intentions in Complex Tasks PDF

  • Rajeev Ranjan, Shalini De Mello, Jan Kautz. Light-weight Head Pose Invariant Gaze Tracking PDF

ECCV 2018

  • Tobias Fischer, Hyung Jin Chang, Yiannis Demiris. RT-GENE: Real-Time Eye Gaze Estimation in Natural Environments PDF Code

  • Ernesto Brau, Jinyan Guan, Tanya Jeffries, Kobus Barnard. Multiple-Gaze Geometry: Inferring Novel 3D Locations from Gazes Observed in Monocular Video PDF

  • Yin Li, Miao Liu, James M. Rehg. In the Eye of Beholder: Joint Learning of Gaze and Actions in First Person Video PDF

  • Yifei Huang, Minjie Cai, Zhenqiang Li, Yoichi Sato. Predicting Gaze in Egocentric Video by Learning Task-Dependent Attention Transition PDF Code

  • Eunji Chong and Nataniel Ruiz and Yongxin Wang and Yun Zhang and Agata Rozga and James Rehg. Connecting Gaze, Scene, and Attention: Generalized Attention Estimation via Joint Modeling of Gaze and Scene Saliency PDF

  • Seonwook Park and Adrian Spurr and Otmar Hilliges. Deep Pictorial Gaze Estimation PDF Code

  • Cheng, Yihua and Lu, Feng and Zhang, Xucong. Appearance-Based Gaze Estimation via Evaluation-Guided Asymmetric Regression PDF

  • Yu Yu, Gang Liu, Jean-Marc Odobez. Deep Multitask Gaze Estimation with a Constrained Landmark-Gaze Model PDF

BMVC 2018

  • Cristina Palmero, Javier Selva, Mohammad Ali Bagheri, Sergio Escalera. Recurrent CNN for 3D Gaze Estimation using Appearance and Shape Cues PDF Code

  • Liu, Gang and Yu, Yu and Funes-Mora, Kenneth A and Odobez, Jean-Marc and SA, Eyeware Tech. A Differential Approach for Gaze Estimation with Calibration PDF

ICCV 2017

  • George Leifman, Dmitry Rudoy, Tristan Swedish, Eduardo Bayro-Corrochano, Ramesh Raskar. Learning Gaze Transitions From Depth to Improve Video Saliency Estimation PDF

  • Kang Wang, Qiang Ji. Real Time Eye Gaze Tracking With 3D Deformable Eye-Face Model PDF

  • Haoping Deng and Wangjiang Zhu. Monocular Free-Head 3D Gaze Tracking with Deep Learning and Geometry Constraints PDF Code

  • Adria Recasens and Carl Vondrick and Aditya Khosla and Antonio Torralba. Following Gaze in Video PDF Code

CVPR 2017

  • Nour Karessli, Zeynep Akata, Bernt Schiele, Andreas Bulling. Gaze Embeddings for Zero-Shot Image Classification PDF Code

  • Mengmi Zhang, Keng Teck Ma, Joo Hwee Lim, Qi Zhao, Jiashi Feng. Deep Future Gaze: Gaze Anticipation on Egocentric Videos Using Adversarial Networks PDF Code

  • Xucong Zhang and Yusuke Sugano and Mario Fritz and Andreas Bulling. It's Written All Over Your Face: Full-Face Appearance-Based Gaze Estimation PDF

Other 2017

  • Xucong Zhang and Yusuke Sugano and Andreas Bulling. Everyday Eye Contact Detection Using Unsupervised Gaze Target Discovery PDF

ECCV 2016

  • Erroll Wood and Tadas Baltrusaitis and Louis-Philippe Morency and Peter Robinson and Andreas Bulling. A 3D Morphable Eye Region Model for Gaze Estimation PDF

  • Ganin, Yaroslav, Daniil Kononenko, Diana Sungatullina, and Victor Lempitsky. DeepWarp: Photorealistic Image Resynthesis for Gaze Manipulation PDF Code

CVPR 2016

  • Kyle Krafka and Aditya Khosla and Petr Kellnhofer and Harini Kannan and Suchendra Bhandarkar and Wojciech Matusik and Antonio Torralba. Eye Tracking for Everyone PDF Code

  • Pei Yu and Jiahuan Zhou and Ying Wu. Learning Reconstruction-Based Remote Gaze Estimation PDF

  • Laszlo A. Jeni and Jeffrey F. Cohn. Person-Independent 3D Gaze Estimation Using Face Frontalization PDF

arXiv Papers

Datasets

Dataset RGB/RGB-D Image type Annotation type Images Distance Head pose annot. Gaze annot. Head pose orient.
MPII Gaze RGB Face + Eye Patches Gaze Vector 213.659 40-60cm Y Y Frontal
BIWI RGB-D Camera frame Head pose vector ≈ 15.500 100cm Y N All
CMU Multi-Pie RGB Camera frame 68 Facial landmarks 755.370 ≈ 300cm Y N All
Coffeebreak RGB Low res. face image Head pose vector 18.117 Varying Y N All
Columbia RGB High res. camera image Gaze vector 5.880 200cm 5 orient. Y Frontal
Deep Head Pose RGB-D Camera frame Head pose vector 68.000 ≈ 200-800cm Y N All
EYEDIAP RGB-D Face + eye patches Gaze vector ≈ 62.500 80-120cm Y Y Frontal
Gaze Capture RGB Face + eye patches 2D pos on screen > 2.5M 80-120cm Y Y Frontal
ICT 3D Head pose RGB-D Camera frame Head pose vector 14.000 ≈ 100cm Y N All
Rice TabletGaze RGB Tablet camera video 2D pos on screen ≈ 100.000 30-50cm N Y Frontal
RT-GENE RGB-D Face + eye patches Gaze vector 122.531 80-280cm Y Y All
SynthesEyes RGB Synthesized eye patches Gaze vector 11.382 Varying Y Y All
UnityEyes RGB Synthesized eye patches Gaze vector 1M Varying Y Y All
UT Multi-view RGB Eye area + eye patches Gaze vector 1.152.000 60cm Y Y All
Vernissage RGB (Robot) camera frame Head pose vector Unknown Varying Y N

Reference

Many papers collections are from Awesome-Gaze-Estimation by Computer Vision Research Lab at the University of Birmingham

Contribution

If you have anything that you think they are awesome related to Gaze Estimation, feel free to send a pull request

License

CC0

To the extent possible under law, Zhuoran Wu has waived all copyright and related or neighboring rights to this work. If you want to use any items in this list, please refer their own License.

About

A curated list of awesome gaze estimation frameworks, datasets and other awesomeness.

Topics

Resources

License

Code of conduct

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published