UNCOVER PROJECT

UNsighted COmputer Vision

INTRO

UNCOVer is a project to help sightless person to see objects and also reading text. In this github repository you will found the needed source codes to run the program on your own device.

WHAT DO YOU NEED

Azure Account

You need an account to access Azure Cognitive Services.

Azure Vision Cognive Services

Extract rich information from images to categorize and process visual data—and perform machine‑assisted moderaon of images.

Azure Speech Services

Swily convert audio to text for natural responsiveness. The Speech to Text and Text to Speech API is part of the Speech services.

Python

Python is used for simplicity, versality, and cross‑plaorm compability. Azure Cognive Services supports Python.

Raspbian OS (Optional - If you don't use Raspberry Pi, use any OS you need.)

Raspbian OS is the default OS of Raspberry Pi. Raspbian is based on linux. The OS will offer flexibility in developing the software.

Used Dependencies

Install the following dependencies via pip:

  
  pip install tensorflow
  pip install numpy
  pip install scipy
  pip install pillow
  pip install matplotlib
  pip install h5py
  pip install keras
  pip install https://github.com/OlafenwaMoses/ImageAI/releases/download/2.0.2/imageai-2.0.2-py3-none-any.whl
  pip install azure-cognitiveservices-speech
  pip install requests
  pip install pyglet
  

Material & documentations:

A Quickstart guide on using Azure Speech Services on Python

https://docs.microsoft.com/en-us/azure/cognitive-services/speech-service/quickstart-python

A Quickstart guide on using Azure Text-to-Speech on Python

https://docs.microsoft.com/en-us/azure/cognitive-services/speech-service/quickstart-python-text-to-speech