Medical scans like CT and MRI contain detailed 3D information about the human body, but doctors usually view them on flat screens. This means surgeons often need to mentally reconstruct complex anatomy from many 2D slices.
Voxel MR was inspired by the idea that medical data should be explored in 3D space, not just on a monitor. With mixed reality and precision stylus input, doctors could interact with patient scans in a more natural and intuitive way.
Voxel MR is a concept for a mixed reality platform that turns medical scans into interactive 3D models.
Doctors could:
- View CT or MRI scans as volumetric 3D anatomy
- Rotate, zoom, and slice through the model
- Use a stylus to mark tumors, vessels, or surgical paths
- Collaborate with other clinicians in the same virtual workspace
The goal is to make surgical planning more visual, interactive, and collaborative.
Voxel MR is currently a conceptual project. The focus was designing how such a system could work.
The proposed system would use:
- Unity for the mixed reality environment
- XR SDKs for spatial interaction
- Stylus input for precise annotation
- DICOM processing to convert medical scans into 3D voxel models
The idea is to transform medical scan data into an immersive environment where clinicians can explore and plan procedures.
One challenge was understanding how to display large medical imaging datasets in real time in a mixed reality environment.
Another challenge was designing interactions that would be simple and precise enough for medical use, since surgical planning requires high accuracy.
We designed a concept that shows how mixed reality and stylus interaction could improve medical imaging workflows.
We created a clear idea for how doctors could interact with 3D patient anatomy in a more intuitive way.
We learned that spatial computing has huge potential in healthcare. Medical data is naturally three-dimensional, so viewing and interacting with it in 3D could make planning procedures easier and more collaborative.
The next step is to build a working prototype.
Future development would include:
- Rendering real medical scan data in mixed reality
- Adding stylus-based annotation tools
- Enabling collaboration between multiple users
The long-term vision is to create a platform that helps surgeons plan procedures more clearly before entering the operating room.