Eye of God

---

About

The World Health Organization puts the global figure of visually-impaired and blind people at 285 million. For these people, navigating busy urban landscapes can be extremely challenging. To offer a solution to the urban-dwelling visually-impaired, we built “Eye of God”. It is an easy-to-use navigation system for visually impaired people, acting as their “virtual-cane” to help them navigate to their destination all by themselves without needing the assistance of other people.

One reason why blind people typically stay close to home is because they sense the world is not made for them. It would be really wonderful for blind people to feel they can visit new places on their own, and for them to be able to say, 'I can walk through malls or venues without this sense of hopelessness or of missing information.'

The Eye of God navigation system comes in two modes: Indoor Navigation and Outdoor Navigation.

Indoor Navigation: The user is prompted to speak out a destination like “General Ward Sign” in a hospital. Once the system recognises the said text in the vicinity, a pulsating vibration will be given on the motor of the belt which is in the direction of the destination. For all the other objects in the frame, a constant vibration will be produced on detection, to avoid deviation from the path.

Outdoor Navigation: The user is prompted to speak out the destination, and the most optimal route is calculated. Since blind people are more efficient in hearing and possess stronger perception than normal people, therefore the system is focused on alerting the user through vibration (Haptic) and voice feedback. Step by step sound-based navigation commands are provided along with alerting the user about obstacles in the path through vibration from four motors mounted on a waist belt. Two pulses followed by constant vibration will be provided for pre-determined dangerous objects. When the user needs to make a turn, the system also provides the exact measure (in degrees) of the turn along with pulsating haptic feedback through leftmost or the right most motor depending upon the turn to inform the user the correct direction to turn to, to ensure user stays on route. This innovative use of technology can help visually impaired people feel more empowered and independent, thus bridging the gap and getting them at par with the sighted ones.

In accordance with:

• United Nations' Sustainable Development Goal 10: Reduced Inequalities.

• United Nations' Sustainable Development Goal 9: Industry, Innovation, & Infrastructure.

• United Nations' Sustainable Development Goal 16: Peace, Justice & Strong Institutions.

---

App Workflow

• Outdoor Navigation

• Indoor Navigation

How to run

Flutter Project:

eye_of_god

ESP32 Code:

Compile and execute the ESP_Belt/ESP_Belt.ino file on an ESP32 board with the necessary circuitary.

OpenCV CPP Setup:

1. Download OpenCV framework for iOS:https://docs.opencv.org/4.5.2/d5/da3/tutorial_ios_install.html
2. Copy or create symlinks: opencv2.framework to native_opencv/ios
3. Open Runner.xcworkspace and copy OpenCV framework to Runnner(.xcproject) and Runner(.xcworkspace).

Google Maps Setup:

1. Paste Google Maps API Key ios/Runner/AppDelegate.swift: GMSServices.provideAPIKey("YOUR-API-KEY")

Xcode Setup:

1. Change the development team in Targets/Runner/Signing&Capabilities to your Apple ID.
2. Add a unique Bundle identifier

Model Files:

Incase the model files ("*.tflite") are missing from eye_of_god/assets folder, download it from here and place it in eye_of_god/assets: https://drive.google.com/drive/folders/1UU3Cknl5Ns4tQJxeLE_aPkNXSMrRk8VF?usp=sharing

Run the app using flutter run in the main directory of the project eye_of_god.

---

Circuit Diagram

---

For Outdoor Navigation:

1. Turn on the belt for the app to pair automatically with it.
2. Run the Flutter Application on your Phone and mount it to a VR headset.
3. Press the button on the belt to activate speech input and dictate “Start Outdoor Navigation”.
4. Dictate your destination starting with "Take me to <your destination here>".
5. Follow the commands dictated by the app and feedback from vibration motors to reach the destination.

For Indoor Navigation:

1. Turn on the belt for the app to pair automatically with it.
2. Run the Flutter Application on your Phone and mount it to a VR headset.
3. Press the button on the belt to activate speech input and dictate "Start Indoor Navigation".
4. Dictate the label of your destination starting with "Take me to <destination label here>".
5. Follow the pulsating motor to reach your destination.

---

App Screenshots

• Outdoor Mode

• Indoor Mode

---

References

https://github.com/intel-isl/MiDaS

https://medium.com/flutter-community/integrating-c-library-in-a-flutter-app-using-dart-ffi-38a15e16bc14

https://stackoverflow.com/questions/62212942/how-to-use-opencv-with-dartffi-on-ios

https://medium.com/dartlang/dart-asynchronous-programming-isolates-and-event-loops-bffc3e296a6a

https://medium.com/@am15hg/real-time-object-detection-using-new-tensorflow-lite-flutter-support-ea41263e801d

---

Link to the Demo Video: [Eye of God](https://youtu.be/zipQJU651U0)
---

Developed by Team Hack Inversion