📄 Towards Realistic Ultrasound Fetal Brain Imaging Synthesis (👶 🧠 🤖)

Michelle Iskandar 2, Harvey Mannering 1, Zhanxiang Sun 1, Jacqueline Matthew 2, Hamideh Kerdegari 2, Laura Peralta 2, Miguel Xochicale 1
1 University College London, and 2 King’s College London

Abstract

Prenatal ultrasound imaging is the first-choice modality to assess fetal health. Medical image datasets for AI and ML methods must be diverse (i.e. diagnoses, diseases, pathologies, scanners, demographics, etc), however there are few public ultrasound fetal imaging datasets due to insufficient amounts of clinical data, patient privacy, rare occurrence of abnormalities in general practice, and limited experts for data collection and validation. To address such data scarcity, we proposed generative adversarial networks (GAN)-based models, diffusion-super-resolution-GAN and transformer-based-GAN, to synthesise images of fetal ultrasound brain planes from one public dataset. We reported that GAN-based methods can generate 256x256 pixel size of fetal ultrasound trans-cerebellum brain image plane with stable training losses, resulting in lower FID values for diffusion-super-resolution-GAN (average 7.04 and lower FID 5.09 at epoch 10) than the FID values of transformer-based-GAN (average 36.02 and lower 28.93 at epoch 60). The results of this work illustrate the potential of GAN-based methods to synthesise realistic high-resolution ultrasound images, leading to future work with other fetal brain planes, anatomies, devices and the need of a pool of experts to evaluate synthesised images.

Figure. Results from Diffusion-Super-resolution-GAN (DSR-GAN) and transformer-based-GAN (TB-GAN): (a) Training losses for Generator and Discriminator networks, (b) FID scores, and (c) 256x256 pixel size trans-cerebellum images of two randomised batches (B1, B2) of real and synthesised (DSR-GAN and TB-GAN).

Clone repository

After generating your SSH keys as suggested here (or here with few extra notes). You can then clone the repository by typing (or copying) the following lines in a terminal:

mkdir -p ~/repositories/budai4medtech && cd ~/repositories/budai4medtech # suggested path
git clone git@github.com:budai4medtech/midl2023.git

Citations

BibTeX to cite

@misc{iskandar2023realistic,
      author={
      	Michelle Iskandar and 
      	Harvey Mannering and 
      	Zhanxiang Sun and 
      	Jacqueline Matthew and 
      	Hamideh Kerdegari and 
      	Laura Peralta and 
      	Miguel Xochicale},
      title={Towards Realistic Ultrasound Fetal Brain Imaging Synthesis}, 
      year={2023},
      eprint={2304.03941},
      archivePrefix={arXiv},
      primaryClass={eess.IV}
}

Contributors

Thanks goes to all these people (emoji key):

Michelle Iskandar 💻 🤔 🔧

Harvey Mannering 💻 🤔 🔧

Zhanxiang (Sean) Sun 💻 🤔 🔧

Jacqueline Matthew 🔬 🤔

Hamideh Kerdegari 🔬 🤔

Laura Peralta 🔬 🤔

Miguel Xochicale 💻 🔬 🤔 🔧 📖 🔧

This work follows the all-contributors specification.
Contributions of any kind welcome!