Skip to content

D-VPN/M2-D-VPN

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

53 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Team Name: D-VPN

Problem Code: M2

Problem Statement:

Build a model to recognize the hand sign-language of deaf and dumb. Live video through mobile/web-cam should recognize the sign language in real time.

Reason / Motivation:

Right now, in teh world there are more than 38 crore people who are deaf & dumb (we'll address them as specially abled). These people often find themselves amidst a sea of loneliness as people often find it difficult to communicate with them since the Sign Language used by them is difficult to grasp.

Also, there are no such app present in the market, that help in, recognising the sign language gestures at real time and translate them for a common user, so that he/she can understand a specially abled and also befriend them.

Solution?

Team D-VPN brings to you Gesture Talk - an app that promises to be user-friendly and work on Machine Learning in order to decode for the normal user at real-time, what the specially abled is trying to convey through his/her hand gestures via the sign language.

With an attractive and user-friendly UI of the Native app that our Machine Learning Model will be incorporated into, we plan to bring everyone closer. Regardless of their ability and way of communication. The Market Validation for such a product is very high, as no solutions other than to learn the Sign Language from scratch exists.

Features of Model & App:

  1. Attractive & User-friendly UI
  2. Model Predicts the Entire Sign-Language Alphabets and Digits
  3. Real-time translation into words/letters
  4. Voice assistant enabled
  5. Model trained over almost 90,000 images collectively

Screenshots of the App:

HOME PAGE PREDICTIONS REAL-TIME SENTENCE FORMATION

Data Resources:

  1. Turkey Ankara Ayrancı Anadolu High School's Sign Language Digits Dataset (Digits)
  2. ASL Alphabet (Alphabets)

Tech Stack Used:

Use-Case Technology
Languages Python Dart
Machine Learning Tensorflow Pandas Matplotlib Python Keras
Frontend Flutter
Tools Jupyter Git GitHub
OS Windows

Team Members & Contributions:

All of us are IT Engineers in making, at K. J. Somaiya College of Engineering

  1. Darshan Satra - GitHub
  2. Nikhil Sharma - GitHub
  3. Param Shendekar - GitHub
  4. Vishal Salgond - GitHub

Releases

No releases published

Packages

No packages published

Contributors 4

  •  
  •  
  •  
  •  

Languages