Skip to content

CaedenZ/distractionModel

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

55 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Concentration Index Generator

This program is developed based on a concentration index model found in (Sharma, P. et al., 2019. Student Engagement Detection Using Emotion Analysis, Eye Tracking and Head Movement with Machine Learning). The model uses the computer webcam to calculate a CI based on a composite score of emotional state and eye/head movement, and displays a real-time Engagement and Emotional Classification.

The program follows the emotion weights of the original model but the authors have constructed a distraction index based on eye gaze and eye size. Please see the (Concentration Index.xlsx)for more information. This program does not account for head position, unlike Reddy et. al.

The model for emotional detection is based on:

Arriaga, O. et. al. "Real-time Convolutional Neural Networks for Emotion and Gender Classification." arXiv preprint arXiv:1710.07557 (2017).

The code (66% accuracy for emotional detection- as benchmarked by Arriaga et. al.) is adapted from:

Emotional Detection

https://github.com/balram2697/Face-Emotion-Recognition

https://www.kaggle.com/c/challenges-in-representation-learning-facial-expression-recognition-challenge/data

Eye Gaze Detection/Measurement

https://pysource.com/2019/01/07/eye-detection-gaze-controlled-keyboard-with-python-and-opencv-p-1/

Additional References:

Reddy, T.K. et. al, 2019. Autoencoding Convolutional Representations for Real-Time Eye-Gaze Detection.

Rodzi, A.h. et. al., 2018. Vision based Eye Closeness Classification for Driver’s Distraction and Drowsiness Using PERCLOS and Support Vector Machines: Comparative Study between RGB and Grayscale Images.

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages