This project aims to develop pairs of sensory glasses for the visually impaired with IoT and Smart City Capabilities. Through and array of Ultrassonic Sensors, 3D distance information is mapped, sent to a smartphone (using an app), processed and transmitted through 3D sound via headphones. Beyond this sonification feature, other IoT and Smart City Capabilities can be added thanks to the app and the NRF24 module on the glasses.
Layout of the Project
This project consists of 4 main components:
- Glasses with Arduino
- Smartphone App
- Web Server
- IoT and Smart City Devices
Glasses with Arduino
The Arduino Code and PCB layouts for this component are found in the "Glasses_Arduino" folder.
The Arduino used is the Pro_Mini, and it is connected to 3 modules:
- Array of Ultrassonic Sensors
- Smartphone Comunication Module
- Remote Comunication Module
For the sonification, the Arduino receives distance information from a Array of Ultrassonic Sensors, it filters these information and sends it to the Smartphone through the Bluetooth Module.
Both the NRF24 and the Smartphone allow Synesthesia Vision to connect with other IoT and Smart City devices.
The Android App can be found in the "Synesthesia_APP" folder, the app is developed on Android Studio.
The app assists the sonification feature, supplies the user with audio feedback for the NRF24 triggered features and connects with the Web Server to supply IoT capabilities.
More information about the Smartphone App can be found in the App Folder.
Web Server and ioT
The NodeJS Server app can be found in the "Server" folder.
The server connects with the smartphone, sendind and receiving requests for features found in the internet, such as retreiving weather information.
More information about the Server App and a list of IoT features can be found in the Server folder.
Smart City Devices
We aim to construct a porwerfull tool for the visually impaired to interact with day-to-day activities with relative ease. This can be done with the integration with Smart City Devices, such as: bus stops and traffic lights.
- Michael Barney Jr
- Jonathan Kilner
- Gilmar Brito
- Aida Araújo Ferreira
See also the list of contributors who participated in this project.
This project is licensed under the GNU General Public License v3.0 License - see the LICENSE file for details.
This project was developped in association with the Pernambuco Institute of Science Education and Technology: