Skip to content

Project to identify distressed users, through facial recognition, and offer noncommittal resources and support.

Notifications You must be signed in to change notification settings

pleteaud/student_sentiment_sensor

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

The Student Sentiment Sensor (SSS)

studentsWalking_img

Our Northeastern University senior capstone project

by Jack Carson, Tyler Ceballo, Mark Morton, Dave Pleteau, & John Privitera

The premise

Some context

44% of college students in a 2021 USA national study reported symptoms of anxiety and depression (“College students and Depression,” Mayo Clinic Health System, 07-Sep-2021). Although on-campus mental health resources exist, a limited amount of people may make the time for them and many who need help are reluctant to reach out for various reasons.

Our solution

Leveraging 8MP computer vision (CV) from the FER Python library running on a Raspberry Pi we rapidly—in 3.0s—identified passing students who appear distressed and seeded a React-based touchscreen interaction with them.

We predicted each student's core stressors with a combination of the CV module’s facial emotion (classifying out of 7 total) detection and a Python-constructed decision tree of survey-like questions.
q_img

Finally, we provided users with curated support resources by email in order to actively advance student mental health by kickstarting the process.
resource_img

Getting started with the stack

Prerequisites

  • Python3 is installed.
  • Node.js is installed (Version < 17.0)
    • Note: Do not install node via a package manager like Debian's apt. Consider using nvm.
    • Note: "sudo apt-get install node npm" may work/be a potential fix
  • A Linux-type environment works best.

Setup

git clone <remote_url> TODO: it might be necessary to install several packages with pip.

Node local dependencies

First, navigate to the project root directory.

cd ./frontend/fe-filesystem-api/
npm install

Second, open a new terminal and navigate to the project root directory.

cd ./frontend/fe-main/
npm install

Running the app

First, navigate to the project root directory.

cd ./backend/
# `python3` may be substituted for `python` if necessary.
python3 backend.py

Second, open a new terminal and navigate to the project root directory.

cd ./frontend/fe-filesystem-api/
# `yarn` may be substituted for `npm` if desired.
npm start

Third, open a new terminal and navigate to the project root directory.

cd ./frontend/fe-main/
# `yarn` may be substituted for `npm` if desired.
npm start

About

Project to identify distressed users, through facial recognition, and offer noncommittal resources and support.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 66.0%
  • JavaScript 26.3%
  • CSS 4.2%
  • HTML 3.0%
  • Pug 0.5%