What is MedOculus?

MedOculus uses several cutting-edge technologies to improve healthcare for surgeons, dentist and other doctors. Doctors will be able to see, in real time, patient details, medical scans (e.g. MRI) and other data useful during the operations.

Augmented Operation Room

This technology allows to extend the capabilities of any Operation Room (OR) with augmented reality. The doctors would be able to view the information as Augimented Reality Projections that are scanned by the camera from the markers displayed on the smartwatch and shown in the Oculus Rift Headset whenever they need it. The projections can be zoomed in and turned in all 3d senses.

Portable Scans

MedOculus can also be employed during consultations with the patient for discussing the results of the analysis. The 3D visualization will dramatically improve the communication between the doctor and the patient. The patients can install the software on their laptop to be able to look at their scans while being at home. The scan markers are printable and easily transportable.

Cradle of Technologies

Here is the list of devices that compose the MedOculus:

• Oculus Rift: Virtual Reality headset
• Leap Motion: Sensor device that supports hand and finger motions as input
• 2x HD Cameras (only 1 used in the prototype, due to lack of resources)
• Moto 360: Android smart watch

The following technologies have been used:

• Salesforce: Apps for management of patient's data.
• Salesforce1: Patient's data dynamically stored and retrieved from the platform.
• OpenCV: Image processing in real-time.
• ArUco: Markers for augmented reality.
• OGRE: Object-Oriented Graphics Rendering Engine for the augmented reality.

MedOculus in Action

Here are some screenshots of the working prototype:

Future Plans

MedOculus is created as a proof of concept to demonstrate the possibility of such a technology. Since this project was developed with usability in mind, the prototype is already fully functioning.

More work and, possibly, some investments would push the project even further, improving and adding its capabilities for real uses.

Notes

Thanks to Germanunkol and Fakkoweb for their great help and support!

Also thanks to Salesforce, Accenture, BeMyApp and Ahoy Berlin for the event and the opportunity.

Project created for the hackathon "Hack and Wear", Berlin 2015.