Ho’ohui - Augmented Reality Visualizer with Haptics

Demonstration Video

Project Description:

Ho'ohui is an augmented reality experiment done for a Haptic Interface class at CU Boulder.

Today, mixed reality is an emerging technology and is expected to have high demands in various applications. Therefore, we wanted to give the example on how others can experiment with this technology, in our case with augmented reality to build this open sourced project. Augmented reality tehcnologies right now are expensive and with this type of project it can become more accessible to anyone.

Moreover, most applications in augmented reality do not offer enough kinesthetic communication or the sense of touch by applying forces, vibrations, or motions to the user. Therefore, in our use case scenario we implement haptics to our example of using augmented reality to visualize 3D objects as a designer, in this case on a car that can be manipulated using your hands and feel vibrations on your fingers as response for an object appearing in front of your lenses in physical space.

We enjoyed working on every aspect of this project. Special thanks to the ATLAS Community at CU Boulder and professor Daniel Leithinger for his guidance and advice.

Thank you.

Team Members:

Juan Molina
Matthew Haeger
Aidan Rafferty

Process:

Step 1: Headset Assembly

Pictures:

Step 2: Lenses

Pictures:

Figure: Polish the lense for 3 hours first with waterproof sand paper. Starting at 350 Grit to 1600 Grit, incrementing.

Figrues: Apply plastic polish Novus 2 scratch remover compound using a drill if you have, for 10 minutes.

Step 3: Gloves

Arduino Schematic:

Pictures:

Figure:

Step 4: Screen Displays

Figure: Arragangement of displays.

Figure: Computer Display settings for computer screen.

Figure: Left Display Screen settings.

Figure: Right Display Screen settings.

Step 5: Set up

Schematic:

Figure: (RED) Micro-USB Cables, (BLUE) HDMI Cables, (BLACK) USB Cables

Resources:

• Leap Motion Repository: https://github.com/leapmotion/ProjectNorthStar
• Project North Star Simplified Version Assembly Tutorial: https://exiii.jp/2018/07/25/project_north_star_en/
• Print SLA Lenses: https://github.com/mdrjjn/northStarAssemblyGuide
• 3D Print Parts and Materials: https://docs.google.com/spreadsheets/d/17OPl2oNZefMu_XfwKp9CA5PygzD6_z3uMTJ1lndurGw/edit?usp=sharing
• Mirror Film: https://www.amazon.com/VViViD-One-Way-Bronze-Mirror-Self-Adhesive/dp/B076XHLKC6/ref=sr_1_1?rps=1&ie=UTF8&qid=1533776277&sr=8-1&keywords=window+mirror+film&refinements=p_85%3A2470955011
• Display Screens: https://www.amazon.com/OSOYOO-Monitor-Display-instructions-Raspberry/dp/B01N447AEY/ref=sr_1_1?ie=UTF8&qid=1533769748&sr=8-1&keywords=3.5+inch+monitor+hdmi
• Headgear: https://www.amazon.co.jp/gp/product/B00NXN21DK/
• Plastic Polish: https://www.amazon.com/gp/product/B002UCYRZU/ref=oh_aui_detailpage_o00_s01?ie=UTF8&psc=1
• Previous Github Page: https://github.com/arafferty10/hapticLeapMotion