Deep Learning and Neural Network based Sign Sense is a desktop app made for deaf/ dumb people. This will allow them to talk to anybody rather than just those who can understand their language. There is also a Web version for the same so that app can reach to more people.
Features:
- Sign2Speech can detect hand signs in a frame and can convert them to Speech, according to their respective meaning using mediapipe, keras, cv2, numpy, etc.
- Opposite to this, Speech2Sign can also recognise your voice and can convert it to sign language using speech recognition and OpenAI's Whisper API. It will show an AI-generated video for the signs detected.