- Automatic Gaze Analysis: A Survey of Deep Learning based Approaches by Shreya Ghosh, Abhinav Dhall, Munawar Hayat, Jarrod Knibbe and Qiang Ji. (Paper Arxiv Link)
If we miss your work, please let us know and we'll add it.
A comparison of gaze datasets with respect to several attributes (i.e. number of subjects (# subjects), gaze labels, modality, headpose and gaze angle in yaw and pitch axis, environment (Env.), baseline method, data statistics (# of data), and year of publication.) The abbreviations used are: In: Indoor, Out: Outdoor, Both: Indoor + Outdoor, Gen.: Generation, u/k: unknown, Seq.: Sequence, VF: Visual Field, EB: Eye Blink, GE: Gaze Event, GBRT: Gradient Boosting Regression Trees, GC: Gaze Communication, GNN: Graph Neural Network and Seg.: Segmentation.
CAVE 2013, EYEDIAP 2014, UT MV 2014, OMEG 2015, MPIIGaze 2015, GazeFollow 2015, SynthesEye 2015, GazeCapture 2016, UnityEyes 2016, TabletGaze 2017, MPIIFaceGaze 2017, InvisibleEye 2017, RT-GENE 2018, Gaze360 2019, RT-BENE 2019, NV Gaze 2019, HUST-LBW 2019, VACATION 2019, OpenEDS2019 2019, OpenEDS2020 2020, OpenEDS2021 2021, mEBAL 2020, ETH-XGaze 2020, EVE 2020, Gaze-in-the-Wild 2020, LAEO 2021, GOO 2021, OpenNEEDS 2021
The details of the datasets are mentioned in the table:
A comparison of gaze analysis methods with respect to registration (Reg.), representation (Represent.), Level of Supervision, Model, Prediction, validation on benchmark datasets (validation), Platforms, Publication venue (Publ.) and year. Here, GV: Gaze Vector, Scr.: Screen, LOSO: Leave One Subject Out, LPIPS: Learned Perceptual Image Patch Similarity, MM: Morphable Model, RRF: Random Regression Forest, AEM: Anatomic Eye Model, GRN: Gaze Regression Network, ET: External Target, FV: Free Viewing, HH: HandHeld Device, HMD: Head Mounted Device, Seg.: Segmentation and GR: Gaze Redirection, LAEO: Looking At Each Other.
If you find the survey useful for your research, please consider citing our work:
@article{ghosh2021Automatic,
title={Automatic Gaze Analysis: A Survey of Deep Learning based Approaches},
author={Ghosh, Shreya and Dhall, Abhinav and Hayat, Munawar and Knibbe, Jarrod and Ji, Qiang},
journal={arXiv preprint arXiv:2108.05479},
year={2021}
}
A curated list of papers and datsets for various gaze estimation techniques, inspired by awesome-computer-vision. Mostly Recent papers are here.
- Eye Gaze Estimation/Tracking
- Gaze Trajectory
- Gaze Redirection
- Gaze Zone + Driver Gaze
- Gaze and Attention
- Gaze and Interaction
- Visual Attention
- Uncategorized Papers
- ESCNet: Gaze Target Detection with the Understanding of 3D Scenes - Jun Bao, Buyu Liu, Jun Yu CVPR2022
- Dynamic 3D Gaze from Afar: Deep Gaze Estimation from Temporal Eye-Head-Body Coordination - Soma Nonaka, Shohei Nobuhara, Ko Nishino CVPR2022
- GaTector: A Unified Framework for Gaze Object Prediction - Binglu Wang, Tao Hu, Baoshan Li, Xiaojuan Chen, Zhijie Zhang CVPR2022
- GazeOnce: Real-Time Multi-Person Gaze Estimation - Mingfang Zhang, Yunfei Liu, Feng Lu CVPR2022
- End-to-End Human-Gaze-Target Detection with Transformers - Danyang Tu, Xiongkuo Min, Huiyu Duan, Guodong Guo, Guangtao Zhai, Wei Shen CVPR2022
- Cross-Encoder for Unsupervised Gaze Representation Learning - Yunjia Sun, Jiabei Zeng, Shiguang Shan, Xilin Chen ICCV2021
- Vulnerability of Appearance-based Gaze Estimation
- Generalizing Gaze Estimation with Outlier-guided Collaborative Adaptation
- Weakly-Supervised Physically Unconstrained Gaze Estimation - Rakshit Kothari, Shalini De Mello, Umar Iqbal, Wonmin Byeon, Seonwook Park, Jan Kautz (CVPR 2021)
- Goal-Oriented Gaze Estimation for Zero-Shot Learning - Yang Liu, Lei Zhou, Xiao Bai, Yifei Huang, Lin Gu, Jun Zhou, Tatsuya Harada (CVPR 2021)
- GOO: A Dataset for Gaze Object Prediction in Retail Environments - Henri Tomas, Marcus Reyes, Raimarc Dionido, Mark Ty, Jonric Mirando, Joel Casimiro, Rowel Atienza, Richard Guinto (CVPRW 2021)
- PureGaze: Purifying Gaze Feature for Generalizable Gaze Estimation - Yihua Cheng, Yiwei Bao, Feng Lu
- Gaze Estimation with an Ensemble of Four Architectures - Xin Cai, Boyu Chen, Jiabei Zeng, Jiajun Zhang, Yunjia Sun, Xiao Wang, Zhilong Ji, Xiao Liu, Xilin Chen, Shiguang Shan
- The Story in Your Eyes: An Individual-difference-aware Model for Cross-person Gaze Estimation - Jun Bao, Buyu Liu, Jun Yu
- Bayesian Eye Tracking - Qiang Ji, Kang Wang
- Glance-and-Gaze Vision Transformer - Qihang Yu, Yingda Xia, Yutong Bai, Yongyi Lu, Alan Yuille, Wei Shen
- Gaze Estimation using Transformer - Yihua Cheng, Feng Lu
- Self-supervised learning through the eyes of a child.
Emin Orhan, Vaibhav Gupta, Brenden M. Lake - A Coarse-to-Fine Adaptive Network for Appearance-Based Gaze Estimation.
Yihua Cheng, Shiyao Huang, Fei Wang, Chen Qian, Feng Lu - ETH-XGaze: A Large Scale Dataset for Gaze Estimation under Extreme Head Pose and Gaze Variation. - Xucong Zhang, Seonwook Park, Thabo Beeler, Derek Bradley, Siyu Tang , Otmar Hilliges
- Towards End-to-end Video-based Eye-Tracking. - Seonwook Park, Emre Aksan, Xucong Zhang, Otmar Hilliges
- Deep Learning-based Pupil Center Detection for Fast and Accurate Eye Tracking System. - Kang Il Lee, Jung Ho Jeon, Byung Cheol Song
- Unsupervised Representation Learning for Gaze Estimation. - Yu Yu, Jean-Marc Odobez
- Domain Adaptation Gaze Estimation by Embedding with Prediction Consistency. - Zidong Guo, Zejian Yuan, Chong Zhang, Wanchao Chi, Yonggen Ling, Shenghao Zhang
- Offset Calibration for Appearance-Based Gaze Estimation via Gaze Decomposition. - Zhaokang Chen, Bertram Shi
- Gaze Estimation for Assisted Living Environments. - Philipe Ambrozio Dias, Damiano Malafronte, Henry Medeiros, Francesca Odone
- Learning to Detect Head Movement in Unconstrained Remote Gaze Estimation in the Wild. - Zhecan Wang, Jian Zhao, Cheng Lu, Fan Yang, Han Huang, lianji li, Yandong Guo
- Learning-based Region Selection for End-to-End Gaze Estimation. - Xucong Zhang, Yusuke Sugano, Andreas Bulling and Otmar Hilliges
- Low Cost Gaze Estimation: Knowledge-Based Solutions. - Ion Martinikorena, Andoni Larumbe-Bergera, Mikel Ariz, Sonia Porta, Rafael Cabeza, Arantxa Villanueva (2020 IEEE TIP)
- Gaze Estimation by Exploring Two-Eye Asymmetry.- Yihua Cheng, Xucong Zhang, Feng Lu, Yoichi Sato (2020 IEEE TIP)
- Gaze360: Physically Unconstrained Gaze Estimation in the Wild. - Petr Kellnhofer, Adria Recasens, Simon Stent, Wojciech Matusik, Antonio Torralba
- Few-Shot Adaptive Gaze Estimation.
Seonwook Park, Shalini De Mello, Pavlo Molchanov, Umar Iqbal, Otmar Hilliges, Jan Kautz - [Mixed Effects Neural Networks (MeNets) With Applications to Gaze Estimation.] Yunyang Xiong, Hyunwoo J. Kim, Vikas Singh
- Generalizing Eye Tracking With Bayesian Adversarial Learning. Kang Wang, Rui Zhao, Hui Su, Qiang Ji
- Eyemotion: Classifying Facial Expressions in VR Using Eye-Tracking Cameras.
Steven Hickson, Nick Dufour, Avneesh Sud, Vivek Kwatra, Irfan A. Essa - MPIIGaze: Real-World Dataset and Deep Appearance-Based Gaze Estimation. - Xucong Zhang and Yusuke Sugano and Mario Fritz and Andreas Bulling (2017 IEEE TPAMI)
- InvisibleEye: Mobile Eye Tracking Using Multiple Low-Resolution Cameras and Learning-Based Gaze Estimation. - Marc Tonsen and Julian Steil and Yusuke Sugano and Andreas Bulling
- A low-cost and calibration-free gaze estimator for soft biometrics: An explorative study. - Dario Cazzato and Andrea Evangelista and Marco Leo and Pierluigi Carcagní and Cosimo Distante
- Model-based head pose-free gaze estimation for assistive communication. - Stefania Cristina and Kenneth P. Camilleri
- Fast and accurate algorithm for eye localisation for gaze tracking in low-resolution images.
Anjith George and Aurobinda Routray - Gaze Estimation in the 3D Space Using RGB-D Sensors. - Kenneth A. Funes-Mora and Jean-Marc Odobez
- Appearance-Based Gaze Estimation via Uncalibrated Gaze Pattern Recovery. - Feng Lu and Xiaowu Chen and Yoichi Sato
- Dynamic Fusion of Eye Movement Data and Verbal Narrations in Knowledge-rich Domains.
Ervine Zheng, Qi Yu, Rui Li, Pengcheng Shi, Anne Haake - Neuro-Inspired Eye Tracking With Eye Movement Dynamics. - Kang Wang, Hui Su, Qiang Ji
- CUDA-GR: Controllable Unsupervised Domain Adaptation for Gaze Redirection - Swati Jindal, Xin Eric Wang
- Self-Learning Transformations for Improving Gaze and Head Redirection.
Yufeng Zheng, Seonwook Park, Xucong Zhang, Shalini De Mello, Otmar Hilliges - Photo-Realistic Monocular Gaze Redirection Using Generative Adversarial Networks. - Zhe He, Adrian Spurr, Xucong Zhang, Otmar Hilliges
- Improving Few-Shot User-Specific Gaze Adaptation via Gaze Redirection Synthesis.
Yu Yu, Gang Liu, Jean-Marc Odobez
- Driver Gaze Region Estimation Without Using Eye Movement - Lex Fridman and Philipp Langhans and Joonbum Lee and Bryan Reimer
- EyeGAN: Gaze-Preserving, Mask-Mediated Eye Image Synthesis. - Harsimran Kaur, Roberto Manduchi
- "Looking at the Right Stuff" - Guided Semantic-Gaze for Autonomous Driving. - Anwesan Pal, Sayan Mondal, Henrik I. Christensen
- Dual Attention Guided Gaze Target Detection in the Wild - Yi Fang, Jiapeng Tang, Wang Shen, Wei Shen, Xiao Gu, Li Song, Guangtao Zhai
- Connecting What To Say With Where To Look by Modeling Human Attention Traces - Zihang Meng, Licheng Yu, Ning Zhang, Tamara L. Berg, Babak Damavandi, Vikas Singh, Amy Bearman
- Appearance-Based Gaze Estimation Using Attention and Difference Mechanism - Murthy L R D, Pradipta Biswas
- Visual Focus of Attention Estimation in 3D Scene With an Arbitrary Number of Targets - Remy Siegfried, Jean-Marc Odobez
- Augmented saliency model using automatic 3D head pose detection and learned gaze following in natural scenes. - Daniel Parks and Ali Borji and Laurent Itti
- Improving Natural Language Processing Tasks with Human Gaze-Guided Neural Attention.
Ekta Sood, Simon Tannert, Philipp Mueller, Andreas Bulling
- Glance and Gaze: Inferring Action-Aware Points for One-Stage Human-Object Interaction Detection - Xubin Zhong, Xian Qu, Changxing Ding, Dacheng Tao
- Appearance-Based Gaze Estimation With Online Calibration From Mouse Operations. Yusuke Sugano and Yasuyuki Matsushita and Yoichi Sato and Hideki Koike
- Where are they looking? - Adria Recasens, Aditya Khosla, Carl Vondrick, Antonio Torralba. NIPS 2015
- Connecting Gaze, Scene, and Attention: Generalized Attention Estimation via Joint Modeling of Gaze and Scene Saliency - Eunji Chong, Nataniel Ruiz, Yongxin Wang, Yun Zhang, Agata Rozga, James M. Rehg. ECCV2018
- Understanding Human Gaze Communication by Spatio-Temporal Graph Reasoning - Lifeng Fan, Wenguan Wang, Siyuan Huang, Xinyu Tang, Song-Chun Zhu. ICCV2019
- Detecting Attended Visual Targets in Video - Eunji Chong, Yongxin Wang, Nataniel Ruiz, James M. Rehg. CVPR2020
- PupilTAN: A Few-Shot Adversarial Pupil Localizer - Nikolaos Poulopoulos, Emmanouil Z. Psarakis, Dimitrios Kosmopoulos
- How is Gaze Influenced by Image Transformations? Dataset and Model. - Zhaohui Che, Ali Borji, Guangtao Zhai, Xiongkuo Min, Guodong Guo, Patrick Le Callet (2020 IEEE TIP) [code]
- When Computer Vision Gazes at Cognition. - Tao Gao and Daniel Harari and Joshua Tenenbaum and Shimon Ullman
- A Novel Approach to Real-time Non-intrusive Gaze Finding. - L.-Q. Xu and D. Machin and P. Sheppard
- Non-Intrusive Gaze Tracking Using Artificial Neural Networks. - Shumeet Baluja and Dean Pomerleau
- Interact as You Intend: Intention-Driven Human-Object Interaction Detection. - Bingjie Xu and Junnan Li and Yongkang Wong and Mohan S. Kankanhalli and Qi Zhao
- TurkerGaze: Crowdsourcing Saliency with Webcam based Eye Tracking. - Pingmei Xu and Krista A Ehinger and Yinda Zhang and Adam Finkelstein and Sanjeev R. Kulkarni and Jianxiong Xiao