Skip to content

Merlin-A/SignSense

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

38 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Machine Learning ASL

GitHub license

SignSense

Sign Language Detection & Translation Web App

Developed By -

Toolset 🛠️

Languages, Equipments, Environment

Python Mediapipe Sklearn Numpy OpenCV
Pickle Flask HTML5 CSS3

OverView 🔎


SignSense is a sign language detection system aimed at bridging communication gaps for the hearing impaired.


Sign Language is a vital means of communication for millions of individuals worldwide, particularly those who are deaf or hard of hearing. This software, aptly named SignSense, leverages Computer Vision and Machine Learning techniques to Detect and Translate Sign Language Gestures into Text in real time.

Development 🔧

The project development has been divided into two parts, Model Development & Front-End Integration.

Model Development

This stage involves creation of the Machine Learning Model, and exporting it inorder use in integration.
  • Dataset Creation
  • Data Processing
  • Model Training
  • Model Testing
  • Model Export

  • Front End Integration

    This stage involves creation of the Integrated ML Model with Front End using Flask Framework.

    Implementation 🖑🏾

    1. Simply Download

    2. Open PowerShell in your downloaded directory and run the following command.

      pip download -r requirements.txt 
    3. Once the Process is Complete, run the following Commands.

       cd Deploy 
       python app.py 

      Click on the link, and the browser window would pop up.

    Update

    To create your own model follow the following steps.

    1. cd Model
    2. python collect_imgs.py

    Enter the No. of letters you want to train and the number of images you want to collect for each letter. To start capturing press G.

    1. python create_dataset.py
    2. python train_classifier.py
    3. python test_classifier.py

    Then copy the model.p into the Models directory of Deployment Folder and Simply follow the Implementation.

    Any Suggestion, Contribution and Forking is Highly Appreciated!!