Skip to content

jinsz/awesome-gaze-estimation

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

68 Commits
 
 
 
 

Repository files navigation

Awesome Work on Gaze Estimation

Table of Contents

Review Papers

[Kar-Corcoran2017 IEEE] A Review and Analysis of Eye-Gaze Estimation Systems, Algorithms and Performance Evaluation Methods in Consumer Platforms. [PDF]

Anuradha Kar and Peter Corcoran

[Kar-Corcoran2017 IEEE] A Review and Analysis of Eye-Gaze Estimation Systems, Algorithms and Performance Evaluation Methods in Consumer Platforms. [PDF]

Anuradha Kar and Peter Corcoran

[Wang-etal2015 ISKE] A Survey on Gaze Estimation. [PDF]

Xiaomeng Wang and Kang Liu and Xu Qian

[Sireesha-etal2013 LNEE] A Survey on Gaze Estimation Techniques. [PDF]

M. V. Sireesha and P. A. Vijaya and K. Chellamma

[Hansen2010 TPAMI] In the Eye of the Beholder: A Survey of Models for Eyes and Gaze. [PDF]

D.W. Hansen and Qiang Ji

[Ould-etal2008 HAL] A history of eye gaze tracking. [PDF]

Abdallahi Ould and Mohamed Matthieu and Perreira Da Silva and Vincent Courboulay

[Morimoto-Mimica2005 CVIU] Eye gaze tracking techniques for interactive applications. [PDF]

Carlos H. Morimoto and Marcio R.M. Mimica

Journal Papers

[Zhang-etal2017 TPAMI] MPIIGaze: Real-World Dataset and Deep Appearance-Based Gaze Estimation. [PDF]

Xucong Zhang and Yusuke Sugano and Mario Fritz and Andreas Bulling

[Lu-etal2017 TIP] Appearance-Based Gaze Estimation via Uncalibrated Gaze Pattern Recovery. [PDF]

Feng Lu and Xiaowu Chen and Yoichi Sato

[Cristina-Camilleri2016 CVIU] Model-based head pose-free gaze estimation for assistive communication. [PDF]

Stefania Cristina and Kenneth P. Camilleri

[Mora-Odobez2015 IJCV] Gaze Estimation in the 3D Space Using RGB-D Sensors. [PDF]

Kenneth A. Funes-Mora and Jean-Marc Odobez

[Sugano-etal2015 THMS] Appearance-Based Gaze Estimation With Online Calibration From Mouse Operations. [PDF]

Yusuke Sugano and Yasuyuki Matsushita and Yoichi Sato and Hideki Koike

[Lu-etal2014 TPAMI] Adaptive Linear Regression for Appearance-Based Gaze Estimation. [PDF]

Feng Lu and Yusuke Sugano and Takahiro Okabe and Yoichi Sato

[Lu-etal2014a IVC] Learning gaze biases with head motion for head pose-free gaze estimation. [PDF]

Feng Lu and Takahiro Okabe and Yusuke Sugano and Yoichi Sato

[Sun-etal2014 TMM] Real-Time Gaze Estimation with Online Calibration. [PDF]

Li Sun and Mingli Song and Zicheng Liu and Ming-Ting Sun

[Sugano-etal2013 TPAMI] Appearance-Based Gaze Estimation Using Visual Saliency. [PDF]

Yusuke Sugano and Yasuyuki Matsushita and Yoichi Sato

[Gwon-etal2013 IJARS] Robust Eye and Pupil Detection Method for Gaze Tracking. [PDF]

Su Yeong Gwon and Chul Woo Cho and Hyeon Chang Lee and Won Oh Lee and Kang Ryoung Park

[Corcoran-etal2012 TCE] Real-time eye gaze tracking for gaming design and consumer electronics systems. [PDF]

Peter Corcoran and Florin Nanu and Stefan Petrescu and Petronel Bigioi

[Valenti-etal2012 TIP] Combining Head Pose and Eye Location Information for Gaze Estimation. [PDF]

R. Valenti and N. Sebe and T. Gevers

[Hansen2010 TPAMI] In the Eye of the Beholder: A Survey of Models for Eyes and Gaze. [PDF]

D.W. Hansen and Qiang Ji

[Lee-etal2010 TCE] Gaze tracking system at a distance for controlling IPTV. [PDF]

Hyeon Lee and Duc Luong and Chul Cho and Eui Lee and Kang Park

[Morimoto-Mimica2005 CVIU] Eye gaze tracking techniques for interactive applications. [PDF]

Carlos H. Morimoto and Marcio R.M. Mimica

Conference Papers

CVPR

[Krafka-etal2016] Eye Tracking for Everyone. [PDF]

Kyle Krafka and Aditya Khosla and Petr Kellnhofer and Harini Kannan and Suchendra Bhandarkar and Wojciech Matusik and Antonio Torralba

[Yu-etal2016] Learning Reconstruction-Based Remote Gaze Estimation. [PDF]

Pei Yu and Jiahuan Zhou and Ying Wu

[Zhang-etal2015] Appearance-based gaze estimation in the wild. [PDF]

Xucong Zhang and Yusuke Sugano and Mario Fritz and Andreas Bulling

[Sugano-etal2014] Learning-by-Synthesis for Appearance-Based 3D Gaze Estimation. [PDF]

Yusuke Sugano and Yasuyuki Matsushita and Yoichi Sato

[Mora-Odobez2014] Geometric Generative Gaze Estimation (G3E) for Remote RGB-D Cameras. [PDF]

Kenneth Alberto Funes Mora and Jean-Marc Odobez

[Baltrusaitis-etal2012] 3D Constrained Local Model for rigid and non-rigid facial tracking. [PDF]

T. Baltrusaitis and P. Robinson and L. Morency

[Chen-Ji2011] Probabilistic gaze estimation without active personal calibration. [PDF]

Jixu Chen and Qiang Ji

[Sugano-etal2010] Calibration-free gaze sensing using saliency maps. [PDF]

Yusuke Sugano and Yasuyuki Matsushita and Yoichi Sato

[Williams-etal2006] Sparse and Semi-supervised Visual Mapping with the S^3GP. [PDF]

O. Williams and A. Blake and R. Cipolla

[Zhu-Ji2005] Eye Gaze Tracking under Natural Head Movements. [PDF]

Zhiwei Zhu and Qiang Ji

ICCV

[Deng-Zhu2017] Monocular Free-Head 3D Gaze Tracking with Deep Learning and Geometry Constraints. [PDF]

Haoping Deng and Wangjiang Zhu

[Wood-etal2015] Rendering of Eyes for Eye-Shape Registration and Gaze Estimation. [PDF]

Erroll Wood and Tadas Baltruaitis and Xucong Zhang and Yusuke Sugano and Peter Robinson and Andreas Bullingo

[Alnajar-etal2013] Calibration-Free Gaze Estimation Using Human Gaze Patterns. [PDF]

Fares Alnajar and Theo Gevers and Roberto Valenti and Sennay Ghebreab

[Lu-etal2011a] Inferring human gaze from appearance via adaptive linear regression. [PDF]

Feng Lu and Yusuke Sugano and Takahiro Okabe and Yoichi Sato

[Wang-etal2003] Eye gaze estimation from a single image of one eye. [PDF]

Wang and Sung and Ronda Venkateswarlu

ECCV

[Fischer-etal2018] RT-GENE: Real-Time Eye Gaze Estimation in Natural Environments. [PDF]

Tobias Fischer, Hyung Jin Chang, Yiannis Demiris, Yiannis

[Park-etal2018] Deep Pictorial Gaze Estimation. [PDF]

Seonwook Park and Adrian Spurr and Otmar Hilliges

[Cheng-etal2018] Appearance-Based Gaze Estimation via Evaluation-Guided Asymmetric Regression. [PDF]

Cheng, Yihua and Lu, Feng and Zhang, Xucong

[Wood-etal2016] A 3D Morphable Eye Region Model for Gaze Estimation. [PDF]

Erroll Wood and Tadas Baltrusaitis and Louis-Philippe Morency and Peter Robinson and Andreas Bulling

[Sugano-etal2008] An Incremental Learning Method for Unconstrained Gaze Estimation. [PDF]

Yusuke Sugano and Yasuyuki Matsushita and Yoichi Sato and Hideki Koike

ETRA

[Wood-etal2016] Learning an appearance-based gaze estimator from one million synthesised images. [PDF]

Erroll Wood and Tadas Baltrušaitis and Louis-Philippe Morency and Peter Robinson and Andreas Bulling

[Tonsen-etal2016] Labelled pupils in the wild: a dataset for studying pupil detection in unconstrained environments. [PDF]

Marc Tonsen and Xucong Zhang and Yusuke Sugano and Andreas Bulling

[Mora-etal2014] EYEDIAP: a database for the development and evaluation of gaze estimation algorithms from RGB and RGB-D cameras. [PDF]

Kenneth Alberto Funes Mora and Florent Monay and Jean-Marc Odobez

[McMurrough-etal2012] An eye tracking dataset for point of gaze detection. [PDF]

Christopher D. McMurrough and Vangelis Metsis and Jonathan Rich and Fillia Makedon

[Hansen-etal2010] Homography normalization for robust gaze estimation in uncalibrated setups. [PDF]

Dan Witzner Hansen and Javier San Agustin and Arantxa Villanueva

[Yamazoe-etal2008] Remote gaze estimation with a single camera based on facial-feature tracking without special calibration actions. [PDF]

Hirotake Yamazoe and Akira Utsumi and Tomoko Yonezawa and Shinji Abe

[Hennessey-etal2006] A single camera eye-gaze tracking system with free head motion. [PDF]

Craig Hennessey and Borna Noureddin and Peter Lawrence

[Li-etal2006] openEyes: a low-cost head-mounted eye-tracking solution. [PDF]

Dongheng Li and Jason Babcock and Derrick J. Parkhurst

Others

[Zhang-etal2017 CVPRW] It's Written All Over Your Face: Full-Face Appearance-Based Gaze Estimation. [PDF]

Xucong Zhang and Yusuke Sugano and Mario Fritz and Andreas Bulling

[Zhang-etal2017 UIST] Everyday Eye Contact Detection Using Unsupervised Gaze Target Discovery. [PDF]

Xucong Zhang and Yusuke Sugano and Andreas Bulling

[Jeni-Cohn2016 CVPRW] Person-Independent 3D Gaze Estimation Using Face Frontalization. [PDF]

Laszlo A. Jeni and Jeffrey F. Cohn

[Ghiass-Arandjelovic2016 IJCAI] Highly accurate gaze estimation using a consumer RGB-depth sensor. [PDF]

Reza Shoja Ghiass and Ognjen Arandjelovic

[Wang-etal2015 ISKE] A Survey on Gaze Estimation. [PDF]

Xiaomeng Wang and Kang Liu and Xu Qian

[Jianfeng-Shigang2014 CVPRW] Eye-Model-Based Gaze Estimation by RGB-D Camera. [PDF]

Xucong Zhang and Yusuke Sugano and Mario Fritz and Andreas Bulling

[Schneider-etal2014 ICPR] Manifold Alignment for Person Independent Appearance-Based Gaze Estimation. [PDF]

Timo Schneider and Boris Schauerte and Rainer Stiefelhagen

[Kassner-etal2014 UbiComp] Pupil: an open source platform for pervasive eye tracking and mobile gaze-based interaction. [PDF]

Moritz Kassner and William Patera and Andreas Bulling

[Choi-etal2013 URAI] Appearance-based gaze estimation using kinect. [PDF]

Jinsoo Choi and Byungtae Ahn and Jaesik Parl and In So Kweon

[Liang-etal2013 ETSA] Appearance-based gaze tracking with spectral clustering and semi-supervised Gaussian process regression. [PDF]

Ke Liang and Youssef Chahir and Michèle Molina and Charles Tijus and François Jouen

[Mora-Odobez2012 CVPRW] Gaze estimation from multimodal Kinect data. [PDF]

Kenneth Alberto Funes Mora and Jean-Marc Odobez

[Lu-etal2012 ICPR] Head pose-free appearance-based gaze sensing via eye image synthesis. [PDF]

Feng Lu and Yusuke Sugano and Takahiro Okabe and Yoichi Sato

[Sewell-Komogortsev2010 HFCS] Real-time eye gaze tracking with an unmodified commodity webcam employing a neural network. [PDF]

Weston Sewell and Oleg Komogortsev

[Chen-Ji2008 ICPR] 3D gaze estimation with a single camera without IR illumination. [PDF]

Jixu Chen and Qiang Ji

[Zhu-etal2006 ICPR] Nonlinear Eye Gaze Mapping Function Estimation via Support Vector Regression. [PDF]

Zhiwei Zhu and Qiang Ji and K.P. Bennett

[Tan-etal2002 WACV] Appearance-based eye gaze estimation. [PDF]

Kar-Han Tan and D.J. Kriegman and N. Ahuja

[Morimoto-etal2002 ICPR] Detecting eye position and gaze from a single camera and 2 light sources. [PDF]

C.H. Morimoto and A. Amir and M. Flickner

[Baluja-Pomerleau1994 NIPS] Non-Intrusive Gaze Tracking Using Artificial Neural Networks. [PDF]

Shumeet Baluja and Dean Pomerleau

arXiv Papers

[Xu-etal2015] TurkerGaze: Crowdsourcing Saliency with Webcam based Eye Tracking. [PDF]

Pingmei Xu and Krista A Ehinger and Yinda Zhang and Adam Finkelstein and Sanjeev R. Kulkarni and Jianxiong Xiao

[Gao-etal2014] When Computer Vision Gazes at Cognition. [PDF]

Tao Gao and Daniel Harari and Joshua Tenenbaum and Shimon Ullman

Datasets

Dataset
RGB/
RGB-D
Image type Annotation type #Images Distance Head pose
annot.
Gaze
annot.
Head pose
orient.
BIWI RGB-D Camera frame Head pose vector ≈ 15.500 100cm Y N All
CMU Multi-Pie RGB Camera frame 68 Facial landmarks 755.370 ≈ 300cm Y N All
Coffeebreak RGB Low res. face image Head pose vector 18.117 Varying Y N All
Columbia RGB High res. camera image Gaze vector 5.880 200cm 5 orient. Y Frontal
Deep Head Pose RGB-D Camera frame Head pose vector 68.000 ≈ 200-800cm Y N All
EYEDIAP RGB-D Face + eye patches Gaze vector ≈ 62.500 80-120cm Y Y Frontal
Gaze Capture RGB Face + eye patches 2D pos on screen > 2.5M 80-120cm Y Y Frontal
ICT 3D Head pose RGB-D Camera frame Head pose vector 14.000 ≈ 100cm Y N All
MPII Gaze RGB Face + eye patches Gaze vector 213.659 40-60cm Y Y Frontal
Rice TabletGaze RGB Tablet camera video 2D pos on screen ≈ 100.000 30-50cm N Y Frontal
RT-GENE RGB-D Face + eye patches Gaze vector 122.531 80-280cm Y Y All
SynthesEyes RGB Synthesized eye patches Gaze vector 11.382 Varying Y Y All
UnityEyes RGB Synthesized eye patches Gaze vector 1M Varying Y Y All
UT Multi-view RGB Eye area + eye patches Gaze vector 1.152.000 60cm Y Y All
Vernissage RGB (Robot) camera frame Head pose vector Unknown Varying Y N All
BIWI: [Fanelli-etal2011 LNCS] Real Time Head Pose Estimation from Consumer Depth Cameras. [PDF]

Gabriele Fanelli and Thibaut Weise and Juergen Gall and Luc Van Gool

CMU Multi-Pie: [Gross-etal2008 AFGR] Multi-PIE. [PDF]

Ralph Gross and Iain Matthews and Jeffrey Cohn and Takeo Kanade and Simon Baker

Coffeebreak: [Cristani-etal2011 BMVC] Social interaction discovery by statistical analysis of F-formations. [PDF]

Marco Cristani and Loris Bazzani and Giulia Paggetti and Andrea Fossati and Diego Tosato and Alessio Del Bue and Gloria Menegaz and Vittorio Murino

Columbia: [Smith-etal2013 UIST] Gaze locking: passive eye contact detection for human-object interaction. [PDF]

Brian A. Smith and Qi Yin and Steven K. Feiner and Shree K. Nayar

Deep Head Pose: [Mukherjee-Robertson2015 TMM] Deep Head Pose: Gaze-Direction Estimation in Multimodal Video. [PDF]

Sankha S. Mukherjee and Neil Martin Robertson

EYEDIAP: [Mora-etal2014 ETRA] EYEDIAP: a database for the development and evaluation of gaze estimation algorithms from RGB and RGB-D cameras. [PDF]

Kenneth Alberto Funes Mora and Florent Monay and Jean-Marc Odobez

Gaze Capture: [Krafka-etal2016 CVPR] Eye Tracking for Everyone. [PDF]

Kyle Krafka and Aditya Khosla and Petr Kellnhofer and Harini Kannan and Suchendra Bhandarkar and Wojciech Matusik and Antonio Torralba

ICT 3D Head pose: [Baltrusaitis-etal2012 CVPR] 3D Constrained Local Model for rigid and non-rigid facial tracking. [PDF]

T. Baltrusaitis and P. Robinson and L. Morency

MPII Gaze: [Zhang-etal2017 CVPRW] It's Written All Over Your Face: Full-Face Appearance-Based Gaze Estimation. [PDF]

Xucong Zhang and Yusuke Sugano and Mario Fritz and Andreas Bulling

[Zhang-etal2015 CVPR] Appearance-based gaze estimation in the wild. [PDF]

Xucong Zhang and Yusuke Sugano and Mario Fritz and Andreas Bulling

Rice TabletGaze: [Huang-etal2017 MVA] TabletGaze: dataset and analysis for unconstrained appearance-based gaze estimation in mobile tabletso. [PDF]

Qiong Huang and Ashok Veeraraghavan and Ashutosh Sabharwal

RT-GENE: [Fischer-etal2018 ECVV] RT-GENE: Real-Time Eye Gaze Estimation in Natural Environments. [PDF]

Tobias Fischer and Hyung Jin Chang and Yiannis Demiris

SynthesEyes: [Wood-etal2015 ICCV] Rendering of Eyes for Eye-Shape Registration and Gaze Estimation. [PDF]

Erroll Wood and Tadas Baltrušaitis and Xucong Zhang and Yusuke Sugano and Peter Robinson and Andreas Bulling

UnityEyes: [Wood-etal2016 ETRA] Learning an appearance-based gaze estimator from one million synthesised images. [PDF]

Erroll Wood and Tadas Baltrušaitis and Louis-Philippe Morency and Peter Robinson and Andreas Bulling

UT Multi-view: [Sugano-etal2014 CVPR] Learning-by-Synthesis for Appearance-Based 3D Gaze Estimation. [PDF]

Yusuke Sugano and Yasuyuki Matsushita and Yoichi Sato

Vernissage: [Jayagopi-etal2013 HRI] The vernissage corpus: A conversational Human-Robot-Interaction dataset. [PDF]

Dinesh Babu Jayagopi and Samira Sheiki and David Klotz and Johannes Wienke and Jean-Marc Odobez and Sebastien Wrede and Vasil Khalidov and Laurent Nyugen and Britta Wrede and Daniel Gatica-Perez

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published