MIT VR HACKATHON
Application:
-Purpose: Create a Hololens AR App that focuses on optimizing patient care and reduce medical errors. App functions within hospital premises to provide Dr.’s and rotating medical staff “hands free” access to interact with patient information on inter-hospital secure medical database. With potential to view Medical Imaging (MRI, Xray, Ultrasound) data in 3D to assist with treatment plan.
-Design: Hololens- Unity
-Required Components: UI Database- access and view appropriate patient data- digital patient records- confine app and device (hololens) to secure hospital database- patient information only accessible inter-hospital. Image capture and barcode scan component Input of information- voice to text conversion, scan digital characters on medical devices to text conversion
-Benefit: Reduce risk of medical errors, nosocomial infections and malpractice Faster and “hands free” interface for immediate access to patient information and treatment plan with capability to add new patient information, or update/order treatment plan/schedule/medications, without having to physically handle or flip through paper charts where information can get lost or misplaced. Ability to confirm with the hospital’s secure internal database that the patient and treatment plan are the correct one Ability to monitor patient care inter-hospital and communicate instantly regarding patient care with hospital staff, real time updates
-Sources and Citations:
- Got some code from http://answers.unity3d.com/questions/279750/loading-data-from-a-txt-file-c.html to read from a file.
- Used a menu script from https://www.youtube.com/watch?v=2i06nK_Z5kA.
- Used Microsoft's mixed reality toolkit https://github.com/Microsoft/MixedRealityToolkit-Unity
- Used script from Nick Landry (a Microsoft mentor).