MediVR

Version 1.0.0

A medical Virtual Reality application for exploring 3D medical datasets on the Oculus Quest.

MediVR aims to contribute to the medical field by allowing medical doctors, professors and students to import, view, explore, manipulate and export 3D DICOM studies in an immersive VR environment. The application offers a modern and intuitive user interface to interact with medical datasets in 3D space, rather than on screen.

Developed on Unity, by Dimitar Tahov as a Bachelor's Thesis supervised by Prof. Dr. Kay Otto for Gesundheitselektronik course of study @ HTW Berlin.

Video of app at runtime with imported Abdomen CT Dataset available here.

Video of app at runtime with imported Brain CT Dataset available here.

---

Instructions for Setup & Use

Instructions for project setup

1. Clone repo & open project in Unity.
2. Open Build Settings & switch plattform to Android.
3. Go to folder Resources -> MediVR -> Scenes & load scene VirtualDiagnosticsMenu in Hierarchy.
4. Open Build Settings & add scene to Build (Scene index should be 0).
5. Go to folder Resources -> MediVR -> Scenes & load scene VirtualDiagnosticsCabinet in Hierarchy.
6. Open Build Settings & add scene to Build (Scene index should be 1).

Instructions for DICOM import

For example use, download a sample CT Dataset from the Dicom Library.

1. Open Scene VirtualDiagnosticsMenu in Hierarchy and locate object Dicom_Importer.
2. To set the path to a DICOM directory, go to Menu Bar -> MediVR -> Choose Dicom Source Directory, it should appear under the Inspector Tab.
3. The slices should be ordered in ascending order from distal to proximal side of volume, if other way around, tick box Reverse Slice Order. All Slices in one directory should also be part of only one study.
4. Tick box Annonymize DICOM Meta Data to annonymize data on import.
5. Hit Button Import Dicom Files and wait for confirmation on console. Depending on the amount of files, this may take a couple of minutes, be patient.
6. Button Save Imported Directory Names does not need to be pressed while importing, it is there only in case pre-imported data gets manually copied to project and needs to be added to directory list.
7. Repeat process for all DICOM studies to be imported.
8. Upload new .APK to Quest each time more data is imported into project.

Instructions for project launch

1. After import is complete, hit File -> Build & Run and wait for upoad of .APK file onto Quest.
2. MediVR starts automatically on the device.

Instructions for app use

1. After opening of the app, choose imported study from the menu screen and the virtual cabinet automatically loads.
2. The left wall shows pertinent information related to loaded study.
3. The Back wall shows an instruction screen for use of the application.
4. Hit button Show Instructions on the back wall and get acquainted with all joystick combinations for interaction with the loaded volume.
5. Hit button Show Orientation on the back wall to show patient orientation relative to study. The orientation will appear next to the loaded volume.
6. The 3D Volume is located in the centre of the room. A floating screen above it shows window parameters and scale as well as some buttons.
7. To toggle on/off the cutting of the study's black background, hit Cut Background button on the floating screen.
8. To save all reproduced slices, hit the Save Images button. They will appear in .PNG format in the MediVR/Saved Slices directory on the Quest's internal storage.
9. To reset cutting plane position and window, hit the ↺ button.
10. To go back to menu and quit or choose different study, hit Open Menu button.
11. The right wall has 10 interactive fields for comparing slices. To pin slices to wall, drag them near to the field and release. To remove, either delete or drag outside screen.

Instructions for project launch in Unity

1. Make sure ONLY the VirtualDiagnosticsMenu scene is loaded in hierarchy.
2. Hit Play and click on desired dataset in menu under the Game tab. Next Scene should load automatically.
3. Slices can be duplicated using "d" button on keyboard and the window can be set from quad shader directly.

---

License & Copyright

© Dimitar Tahov 2020

Student @ HTW Berlin, Gesundheitselektronik Bachelor's thesis supervised by Prof. Dr. Kay Otto.

MediVR is licensed under the GNU General Public License v3. The GPLv3 License solely covers the project, excluding ALL externally downloaded assets and packages. The licensing information can be found in the LICENSE file.

---

Contributors

• Dimitar Tahov s0560335@htw-berlin.de

---

Dependencies from Unity Asset Store (free)

• Oculus VR Intergration by Oculus
• fo-dicom by Cureos
• 3D SciFi Starter Kit by Creepy Cat