The app uses a deep learning model developed by a team of volunteers from PyTorch Scholarship Challenge from Facebook, hosted by Udacity.
https://github.com/coalaroot/Pytorch-challenge-side-project/tree/develop
The model is trained on data from https://www.kaggle.com/kumawatmanish/deep-learning-sign-language-dataset/data and data collected by volunteers.
APP FLOW
App launcher icon - sign for butterfly, symbolizes freedom of flight, being able to communicate freely.
The user can search for a sign by typing a word and pressing the search button.
Instructions for installing the app on the phone
- Check if you have the Java Developer Kit, version 7 or greater, already installed on your computer. To check if you have JDK installed (and which version), open a terminal window and type:
java -version
if the JDK is not available, or the version is lower than 7, down load it here:
https://www.oracle.com/technetwork/java/javase/downloads/index.html
- Download Android Studio. Go to
This page will automatically detect your operating system. Accept the terms and conditions to start the download. Double-click the downloaded file and follow all the prompts. After finishing the install, the Setup Wizard will download and install some additional components. Be patient, this might take some time depending on your internet speed.
-
At the start up screen of Android Studio, click Check Out project from Version Control, pick GIT and paste GitHub URL for the project https://github.com/forfireonly/SignLanguage .
-
Connect your phone to your computer with a USB cable. If you're using Windows, you might need to install the appropriate USB driver for your device.
-
Enable USB debugging in the Developer options as following. First, you must enable the developer options: Open the Settings app. (Only on Android 8.0 or higher) Select System. Scroll to the bottom and select About phone. Scroll to the bottom and tap Build number 7 times. Return to the previous screen to find Developer options near the bottom. Open Developer options, and then scroll down to find and enable USB debugging. 6.Run the app on your phone as follows: In Android Studio, click the app module in the Project window and then select Run > Run In the Select Deployment Target window, select your phone, and click OK.
We also developed a sign language interpretation desktop application which is developed in python. Please check our repository on https://github.com/coalaroot/Pytorch-challenge-side-project