The code for backend and frontend are on separate banches:

• Backend
• Frontend

Assist-U

What is Autism? 👩🏽‍⚕️

Autism is a complicated condition that includes problems with communication and behaviour. It can involve a wide range of symptoms and skills. ASD can be a minor problem or a disability that needs full-time care in a special facility. People with autism have trouble with communication. They have trouble understanding what other people think and feel. This makes it hard for them to express themselves, either with words or through gestures, facial expressions, and touch.

How does our application help those children ? 💻

We built a web application to help children with Autism learn Mathematics, Communication skills and help them understand emotions using a facial expression recognition system using a deep learning module with a train accuracy of 95%.

Demo Video

What problem does our application solve ? 🎯

✔ Analyzing Emotions

• For those children who possess the intellectual capacity to function in the general class, speech and language skills can still present a number of obstacles. They may have problems expressing their own emotions and feelings as well perceiving and knowing how to respond to those of others. This can be as extreme as lacking the ability to recognize faces and differentiate between different people, or as subtle as lacking the ability to appreciate and make use of nuance and tone of voice when communicating. The application help understand emotion of the patient using a facial expression recognition system , which is a deep learning module built using Tensorflow keras.

✔ Improving Cognitive Skills

• Processing delays have little do to with the capacity to incorporate and evaluate observations and ideas. Delays in the ability to process verbal or written language have a neurological basis. For those individuals who suffer delays, facts, ideas, and questions are often delayed or even lost in translation from language to thought and vice-versa.
• We have included a couple of games to enhance the experience of chilren using the app, both of them primmarily focus on basic Mathematics and fundamental skills:
• Clock reading skills: This app helps children learn how to read clocks in a fun MCQ styled way.
• Money management skills:
  - Therefore our application has a interactive interface which makes learning process for the children.

       

✔ Learning by visual aid

• Learning skills such as communication and maths from trained professionals with the help of currated videos a may help bring about consistent positive changes in the overall development and assist in day to day activities.

Tech Stack

• Python
• ✔ Tensorflow
• ✔ Keras
• ✔ Scikit-image
• ✔ Flask
• ✔ Numpy
• React
• Html/CSS