RT-GENE: Real-Time Eye Gaze Estimation in Natural Environments
Clone or download
Latest commit d52410b Jan 11, 2019
Type Name Latest commit message Commit time
Failed to load latest commit information.
rt_gene added marker to data Jan 11, 2019
rt_gene_inpainting Fix page numbers Dec 13, 2018
rt_gene_model_training Fix page numbers Dec 13, 2018
.gitignore Update README files Oct 4, 2018
LICENSE first commit Oct 3, 2018
README.md Add link to zenodo Dec 30, 2018


License + Attribution

This code is licensed under CC BY-NC-SA 4.0. Commercial usage is not permitted. If you use this dataset or the code in a scientific publication, please cite the following paper:

author = {Tobias Fischer and Hyung Jin Chang and Yiannis Demiris},
title = {{RT-GENE: Real-Time Eye Gaze Estimation in Natural Environments}},
booktitle = {European Conference on Computer Vision},
year = {2018},
month = {September},
pages = {339--357}

This work was supported in part by the Samsung Global Research Outreach program, and in part by the EU Horizon 2020 Project PAL (643783-RIA).

Overview + Accompanying Dataset

The code is split into three parts, each having its own README contained. There is also an accompanying dataset (alternative link) to the code. For more information, other datasets and more open-source software please visit the Personal Robotic Lab's website: https://www.imperial.ac.uk/personal-robotics/software/.

rt_gene (ROS package)

The rt_gene directory contains a ROS package for real-time eye gaze estimation. This contains all the code required at inference time.


The rt_gene_inpainting directory contains code to inpaint the region covered by the eyetracking glasses.


The rt_gene_model_training directory allows using the inpainted images to train a deep neural network for eye gaze estimation.