Skip to content

Machine Learning for Tissue Deformation Modelling (MALTIDEM): Predicting tissue deformation in real time by expressing results from FEM simulations with machine learning

Notifications You must be signed in to change notification settings

michetonu/MALTIDEM--Machine-Learning-for-Tissue-Deformation-Modelling

Repository files navigation

A machine learning approach for real-time modelling of tissue deformation

Code for the paper "A machine learning approach for real-time modelling of tissue deformation in image-guided neurosurgery", Artificial Intelligence in Medicine, July 2017, https://doi.org/10.1016/j.artmed.2017.07.004

The paper originated from my Master’s thesis "A Data-driven Method for Real-time Modelling of Brain Tumour Deformation", for the M.Res. in Medical Robotics and Image-Guided Intervention at Imperial College London, submitted in September 2016.

ABSTRACT:

This thesis proposes a novel data-based approach to model the deformation of a brain tumour for augmented reality (AR)-based applications in neurosurgery. AR systems have the potential to assist surgeons in the most delicate operations, such as tumour removal, by providing intuitive 3-dimensional visualisations of anatomical structures and targets. One of the major challenges to tackle in order to enhance the clinical impact of this technology is computing and displaying the deformation of the virtual overlay accurately and in real time. This is fundamental to maintain depth perception and thus avoid the degradation of surgical performance. Current soft tissue deform- ation models are characterised by a trade-off between speed and accuracy, or are not apt for patient-specific implementations. The method developed in this thesis employs statistical techniques and machine learning algorithms to derive a model computable in real time. The model is trained on a large set of data (7 × 106 data points) ob- tained through force-driven finite element simulations. Data analysis is carried out to identify the relationship between predictors and output, and to perform feature selection. Three different machine learning algorithms — Artificial Neural Networks, Support Vector Regression, and Gaussian Process Regression — are tested and their performance is evaluated, resulting in real-time predictions of the tumour’s deform- ation with mean errors below 0.4 mm, a value that is considerably lower than the threshold of surgical accuracy and AR’s position uncertainty. The results compare well with the existing literature, providing smaller errors, instantaneous computation, and high patient-specificity. The proposed approach addresses the current needs of image-guided surgical systems, and has the potential to be employed to model the deformation of any type of soft tissue.

Alt text

Dependencies to create custom meshes:

  1. BrainSuite (http://brainsuite.org/) or equivalent software to segment and label the brain
  2. ITK-SNAP (http://www.itksnap.org/) or 3D Slicer (https://www.slicer.org/) or equivalent to segment the tumour.
  3. MATLAB's iso2mesh toolbox (iso2mesh.sourceforge.net/)

A mesh file and the results of the simulations carried out with FEBio are provided.

About

Machine Learning for Tissue Deformation Modelling (MALTIDEM): Predicting tissue deformation in real time by expressing results from FEM simulations with machine learning

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages