Skip to content

This project provides an indoor localization system for visually impaired individuals.

Notifications You must be signed in to change notification settings

Amir-Omidfar/m202Fall19

Repository files navigation

m202Fall19

Project title : An indoor navigation for visually impaired people utilizing Ultra Wide Band Technology

Project Description:

Autonomous navigation is a crucial component for visually impaired people. Outdoors, positioning based on ubiquitous signals is feasible; however, for indoors, no universal positioning solution does exist. Due to the remarkably broad bandwidth, ultra-wideband (UWB) signs offer a proper multipath resolution and allow positioning with sub-meter (10 centimeter) accuracy. Also, because of the implementation of screen-reader software into mobile devices, visually impaired people start using smartphones. While creating a navigation system for the blind, this project focuses on adding sensors such as IMU, in wearable form, for increasing the accuracy of UWB modules. Finally, e-sense technology, implemented in earables, provides haptic feedback in guiding the visually impaired.


Overall Goal:

  • Provide a voice command system to help blind people navigate in indoor locations

Specific aims:

  1. Implementation of an Ultra-wideband (UWB) real time localization system
  2. Calculation of shortest path from user’s location to destination
  3. Android app with speech recognition and text to speech synthesis
  4. Usage of bluetooth beacons to improve upon accuracy of the system
  5. Integration of the three subsystems via communication protocols

Related works (papers and websites)

  1. Minuet: Multimodal Interaction with an Internet of Things
  2. Pozyx: Localization via UWB
  3. Indoor Positioning for Visually Impaired People Based on Smartphones
  4. Analysis of a UWB Indoor Positioning System Based on Received Signal Strength

Methodology, Data Set and Experimental validation plan

  • Methodology:
    1. The indoor localization section: We will be building on an existing work mentioned in the related works section (item #1) to improve the 3d mapping of current UWB modules for indoor localization.
    2. App development section: An Android app would be used to interface between the mapping system and the user.
    3. MQTT Communication Protocol: For receiving sensors data and setting up a CGI server for the purpose of the project.

Work split between the different team members :

  1. Riyya : Android application development
  2. Amir : UWB system setup, overall system integration
  3. Julian : Server setup, support on Android app development

Timeline

Week Indoor localization mapping Android app development
4 General proposal finished
5 First experiments with UWB system used in prior work First approach towards connecting earables with smartphone.
6 Improving the accuracy of the UWB system tag with the inclusion of other sensors in it Work on Android App that sends data to earables
7 Continuation of previous week's work Tests of accuracy with various objects
8 Same as previous two weeks but focusing more on the interconnection between both systems developed
9 Integration of earables and smartphone with UWB system Tests with blindfolded people
10 Final details and tests.
11 Presentation

Midterm Presentation

Midterm Presentation Slides

Final Presentation

Final Presentation Slides

Demos

  1. Final Demo
  2. midterm Localization Demo
  3. midterm Pose Estimation Demo

About

This project provides an indoor localization system for visually impaired individuals.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages