Skip to content

Latest commit

 

History

History
27 lines (14 loc) · 1.71 KB

README.md

File metadata and controls

27 lines (14 loc) · 1.71 KB

Concentration Index Generator

This program is developed based on a concentration index model found in (Sharma, P. et al., 2019. Student Engagement Detection Using Emotion Analysis, Eye Tracking and Head Movement with Machine Learning). The model uses the computer webcam to calculate a CI based on a composite score of emotional state and eye/head movement, and displays a real-time Engagement and Emotional Classification.

The program follows the emotion weights of the original model but the authors have constructed a distraction index based on eye gaze and eye size. Please see the (Concentration Index.xlsx)for more information. This program does not account for head position, unlike Reddy et. al.

The model for emotional detection is based on:

Arriaga, O. et. al. "Real-time Convolutional Neural Networks for Emotion and Gender Classification." arXiv preprint arXiv:1710.07557 (2017).

The code (66% accuracy for emotional detection- as benchmarked by Arriaga et. al.) is adapted from:

Emotional Detection

https://github.com/balram2697/Face-Emotion-Recognition

https://www.kaggle.com/c/challenges-in-representation-learning-facial-expression-recognition-challenge/data

Eye Gaze Detection/Measurement

https://pysource.com/2019/01/07/eye-detection-gaze-controlled-keyboard-with-python-and-opencv-p-1/

Additional References:

Reddy, T.K. et. al, 2019. Autoencoding Convolutional Representations for Real-Time Eye-Gaze Detection.

Rodzi, A.h. et. al., 2018. Vision based Eye Closeness Classification for Driver’s Distraction and Drowsiness Using PERCLOS and Support Vector Machines: Comparative Study between RGB and Grayscale Images.