Skip to content

A curated list of awesome gaze estimation frameworks, datasets and other awesomeness.

License

Notifications You must be signed in to change notification settings

MinjingLin/awesome-gaze

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

27 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Awesome Gaze

A curated list of awesome gaze estimation papers, codes, datasets and other awesomeness.

Table of Content

Review Papers

  • Mohamed Khamis, Florian Alt, Andreas Bulling. The Past, Present, and Future of Gaze-enabled Handheld Mobile Devices: Survey and Lessons Learned PDF

  • Anuradha Kar and Peter Corcoran. A Review and Analysis of Eye-Gaze Estimation Systems, Algorithms and Performance Evaluation Methods in Consumer Platforms PDF

  • kshay A Gawande, Gangotri Nathaney. A Survey on Gaze Estimation Techniques in Smartphone PDF

  • Xiaomeng Wang, Kang Liu, Xu Qian. A Survey on Gaze Estimation PDF

  • M. V. Sireesha, P. A. Vijaya, K. Chellamma. A Survey on Gaze Estimation Techniques PDF

  • D.W. Hansen, Qiang Ji. In the Eye of the Beholder: A Survey of Models for Eyes and Gaze PDF

  • Abdallahi Ould, Mohamed Matthieu, Perreira Da Silva, Vincent Courboulay. A history of eye gaze tracking PDF

  • Carlos H. Morimoto, Marcio R.M. Mimica. Eye gaze tracking techniques for interactive applications PDF

Related Organizations

(refer to YuYu)

Journal Papers

Conference Papers

CVPR 2020

  • Yu, Yu, Odobez, Jean-Marc. Unsupervised Representation Learning for Gaze Estimation PDF Supp

AAAI 2019

  • Dongze Lian, Ziheng Zhang, Weixin Luo, Lina Hu, Minye Wu, Zechao Li, Jingyi Yu, Shenghua Gao. RGBD Based Gaze Estimation via Multi-Task CNN PDF Code

ECCV 2019

  • Petr Kellnhofer, Adria Recasens, Simon Stent, Wojciech Matusik, Antonio Torralba. Gaze360: Physically Unconstrained Gaze Estimation in the Wild PDF Code

  • Seonwook Park, Shalini De Mello, Pavlo Molchanov, Umar Iqbal, Otmar Hilliges, Jan Kautz. Few-Shot Adaptive Gaze Estimation PDF Code

CVPR 2019

  • Yunyang Xiong, Hyunwoo J. Kim, Vikas Singh. Mixed Effects Convolutional Neural Networks (MeNets) with Applications to Gaze Estimation PDF

  • Yu Yu, Gang Liu, Jean-Marc Odobez. Improving Few-Shot User-Specific Gaze Adaptation via Gaze Redirection Synthesis PDF

  • Kang Wang, Hui Su, Qiang Ji. Neuro-inspired Eye Tracking with Eye Movement Dynamics PDF

  • Kang Wang, Rui Zhao, Hui Su, Qiang Ji. Generalizing Eye Tracking with Bayesian Adversarial Learning PDF

ICCV 2019

  • Erik Linden, Jonas Sjostrand, Alexandre Proutiere. Learning to personalize in appearance-based gaze tracking PDF

  • Seonwook Park, Shalini De Mello, Pavlo Molchanov, Umar Iqbal, Otmar Hilliges, Jan Kautz. Few-Shot Adaptive Gaze Estimation PDF Supp Code

PAMI 2019

  • Gang Liu, Yu Yu, Kenneth Alberto Funes Mora, Jean-Marc Odobez. A differential approach for gaze estimation PDF

CVPR 2018

  • Brian Dolhansky, Cristian Canton Ferrer. Eye In-Painting with Exemplar Generative Adversarial Networks PDF Code

  • Yanyu Xu, Yanbing Dong, Junru Wu, Zhengzhong Sun, Zhiru Shi, Jingyi Yu, Shenghua Gao. Gaze Prediction in Dynamic 360° Immersive Videos PDF Code

  • Kang Wang, Rui Zhao, Qiang Ji. A Hierarchical Generative Model for Eye Image Synthesis and Eye Gaze Estimation PDF

  • Arun Balajee Vasudevan, Dengxin Dai, Luc Van Gool. Object Referring in Videos with Language and Human Gaze PDF Code

  • Fan, Lifeng and Chen, Yixin and Wei, Ping and Wang, Wenguan and Zhu, Song-Chun. Inferring Shared Attention in Social Scene Videos PDF

  • Ping Wei, Yang Liu, Tianmin Shu, Nanning Zheng, Song-Chun Zhu. Where and Why Are They Looking? Jointly Inferring Human Attention and Intentions in Complex Tasks PDF

  • Rajeev Ranjan, Shalini De Mello, Jan Kautz. Light-weight Head Pose Invariant Gaze Tracking PDF

ECCV 2018

  • Tobias Fischer, Hyung Jin Chang, Yiannis Demiris. RT-GENE: Real-Time Eye Gaze Estimation in Natural Environments PDF Code

  • Ernesto Brau, Jinyan Guan, Tanya Jeffries, Kobus Barnard. Multiple-Gaze Geometry: Inferring Novel 3D Locations from Gazes Observed in Monocular Video PDF

  • Yin Li, Miao Liu, James M. Rehg. In the Eye of Beholder: Joint Learning of Gaze and Actions in First Person Video PDF

  • Yifei Huang, Minjie Cai, Zhenqiang Li, Yoichi Sato. Predicting Gaze in Egocentric Video by Learning Task-Dependent Attention Transition PDF Code

  • Eunji Chong and Nataniel Ruiz and Yongxin Wang and Yun Zhang and Agata Rozga and James Rehg. Connecting Gaze, Scene, and Attention: Generalized Attention Estimation via Joint Modeling of Gaze and Scene Saliency PDF

  • Seonwook Park and Adrian Spurr and Otmar Hilliges. Deep Pictorial Gaze Estimation PDF Code

  • Cheng, Yihua and Lu, Feng and Zhang, Xucong. Appearance-Based Gaze Estimation via Evaluation-Guided Asymmetric Regression PDF

  • Yu Yu, Gang Liu, Jean-Marc Odobez. Deep Multitask Gaze Estimation with a Constrained Landmark-Gaze Model PDF

BMVC 2018

  • Cristina Palmero, Javier Selva, Mohammad Ali Bagheri, Sergio Escalera. Recurrent CNN for 3D Gaze Estimation using Appearance and Shape Cues PDF Code

  • Liu, Gang and Yu, Yu and Funes-Mora, Kenneth A and Odobez, Jean-Marc and SA, Eyeware Tech. A Differential Approach for Gaze Estimation with Calibration PDF

ETRA 2018

  • Seonwook Park, Xucong Zhang, Andreas Bulling, Otmar Hilliges. Learning to find eye region landmarks for remote gaze estimation in unconstrained settings PDF Code

ICCV 2017

  • George Leifman, Dmitry Rudoy, Tristan Swedish, Eduardo Bayro-Corrochano, Ramesh Raskar. Learning Gaze Transitions From Depth to Improve Video Saliency Estimation PDF

  • Kang Wang, Qiang Ji. Real Time Eye Gaze Tracking With 3D Deformable Eye-Face Model PDF

  • Haoping Deng and Wangjiang Zhu. Monocular Free-Head 3D Gaze Tracking with Deep Learning and Geometry Constraints PDF Code

  • Adria Recasens and Carl Vondrick and Aditya Khosla and Antonio Torralba. Following Gaze in Video PDF Code

CVPR 2017

  • Ashish Shrivastava, Tomas Pfister, Oncel Tuzel, Josh Susskind, Wenda Wang, Russ Webb. Learning from Simulated and Unsupervised Images through Adversarial Training PDF Code

  • Nour Karessli, Zeynep Akata, Bernt Schiele, Andreas Bulling. Gaze Embeddings for Zero-Shot Image Classification PDF Code

  • Mengmi Zhang, Keng Teck Ma, Joo Hwee Lim, Qi Zhao, Jiashi Feng. Deep Future Gaze: Gaze Anticipation on Egocentric Videos Using Adversarial Networks PDF Code

  • Xucong Zhang and Yusuke Sugano and Mario Fritz and Andreas Bulling. It's Written All Over Your Face: Full-Face Appearance-Based Gaze Estimation PDF

Other 2017

  • Xucong Zhang and Yusuke Sugano and Andreas Bulling. Everyday Eye Contact Detection Using Unsupervised Gaze Target Discovery PDF

ECCV 2016

  • Erroll Wood and Tadas Baltrusaitis and Louis-Philippe Morency and Peter Robinson and Andreas Bulling. A 3D Morphable Eye Region Model for Gaze Estimation PDF

  • Ganin, Yaroslav, Daniil Kononenko, Diana Sungatullina, and Victor Lempitsky. DeepWarp: Photorealistic Image Resynthesis for Gaze Manipulation PDF Code

CVPR 2016

  • Kyle Krafka and Aditya Khosla and Petr Kellnhofer and Harini Kannan and Suchendra Bhandarkar and Wojciech Matusik and Antonio Torralba. Eye Tracking for Everyone PDF Code

  • Pei Yu and Jiahuan Zhou and Ying Wu. Learning Reconstruction-Based Remote Gaze Estimation PDF

  • Laszlo A. Jeni and Jeffrey F. Cohn. Person-Independent 3D Gaze Estimation Using Face Frontalization PDF

arXiv Papers

Datasets

Time Dataset RGB/RGB-D Image type Annotation type Subjects Images Distance Head pose annot. Gaze annot. Head pose orient.
2019 Gaze360 RGB Camera frame Gaze Vector 238 172.000 Varying N Y All
2019 NVGaze IR Real Eye + Synthesized Eye patches Gaze Vector 35 2.500.000real
2.000.000Synthesized
Varying N Y All
2019 ShanghaiTechGaze+ RGB-D Face+Eye Patches Gaze Vector 218 165.231 Varying N Y All
2017 MPIIFaceGaze RGB Face + Eye Patches Gaze Vector 15 213.659 40-60cm Y Y Frontal
2017 Rice TabletGaze RGB Tablet camera video 2D pos on screen 51 ≈ 100.000 30-50cm N Y Frontal
2016 Gaze Capture RGB Face + eye patches 2D pos on screen 1474 > 2.5M 80-120cm Y Y Frontal
2016 UnityEyes RGB Synthesized eye patches Gaze vector / 1M Varying Y Y All
2015 SynthesEyes RGB Synthesized eye patches Gaze vector / 11.382 Varying Y Y All
2014 EYEDIAP RGB-D Face + eye patches Gaze vector 16 ≈ 62.500 80-120cm Y Y Frontal
2014 UT Multi-view RGB Eye area + eye patches Gaze vector 50 1.152.000 60cm Y Y All
2013 Columbia RGB High res. camera image Gaze vector 56 5.880 200cm 5 orient. Y Frontal

Gaze Challenges

(refer to YuYu)

gaze challenge held by Facebook Reality Lab

Reference

Many papers collections are from Awesome-Gaze-Estimation by Computer Vision Research Lab at the University of Birmingham

Contribution

If you have anything that you think they are awesome related to Gaze Estimation, feel free to send a pull request

License

CC0

To the extent possible under law, Zhuoran Wu has waived all copyright and related or neighboring rights to this work. If you want to use any items in this list, please refer their own License.

About

A curated list of awesome gaze estimation frameworks, datasets and other awesomeness.

Resources

License

Code of conduct

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published