EmoPal

An Android Application to help children with ASD to develop their Social-Emotional skills through Serious games.

Table of Contents

• About the Project
• Technologies Used
• Product Specifications
• Features
  • Diary
  • Game
• Final Notes

About the Project

EmoPal is an Android Application, developed in Kotlin and Jetpack Compose, to help children with Autism to develop their Social-Emotional skills. The application is designed with two key funcions, a Diary and a game consisting in three levels, each focussed on one aspect of learning emotions and social skills.

Technologies Used

List the technologies/frameworks/languages used in the project.

• Kotlin
• Jetpack Compose
• RoomDB
• Google Cloud Vision API
• Dagger Hilt
• Gradle
• CameraX
• Nested NavGraphs
• Convolutional Neural Network
• TensorFlowLite
• GoogleColab

Product Specifications

Features

Highlights of the main features of the application.

Diary

• Take pictures of current emotion
• Automatic categorisation of the expressed emotion
• History display of the pictures taken and categorised
• Delete previously saved pictures through pop up menu

Match the emotion Game

• Set of pictures categorised in Happiness, Anger, Sadness and Surprise
• Three levels of increasing difficulty
• Automatic recognition of the emotion expressed
• Comparison between picture shown and picture taken

Final Notes

This project served as a working prototype and more development is needed. A custom model has been developed to allow the application to run offline and without connecting to the Google Cloud Vision API.
The model is ~70% accurate, but further tests need to be carried out.
The produced model is a TensorFlowLite model trained with Keras using Convolutional Neural Network (CNN).
The dataset used is FER-2013.