Skip to content

xmindflow/Awesome-Implicit-Neural-Representations-in-Medical-imaging

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 
Β 
Β 
Β 
Β 

Repository files navigation

Implicit Neural Representation in Medical Imaging: A Comparative Survey
ICCV 2023 CVAMD Workshop

Awesome License: MIT PRs Welcome

πŸ”₯πŸ”₯ This is a collection of awesome articles about Implicit Neural Representation networks in medical imagingπŸ”₯πŸ”₯

πŸ“’ Our review paper published on arXiv: Implicit Neural Representation in Medical Imaging: A Comparative Survey ❀️

Citation

@inproceedings{molaei2023implicit,
  title={Implicit neural representation in medical imaging: A comparative survey},
  author={Molaei, Amirali and Aminimehr, Amirhossein and Tavakoli, Armin and Kazerouni, Amirhossein and Azad, Bobby and Azad, Reza and Merhof, Dorit},
  booktitle={Proceedings of the IEEE/CVF International Conference on Computer Vision},
  pages={2381--2391},
  year={2023}
}

Introduction

Implicitly representing image signals has gained popularity in recent years for a broad range of medical imaging applications. The most motivating reasons are the following:

  • Memory efficiency: The amount of memory demanded to represent the signal is not restricted by the signal's resolution.
  • Unlimited Resolution: They take values in the continuous domain, meaning they can generate values for coordinates in-between the pixel or voxel-wise grid
  • Effective data usage: They can learn to handle reconstruction and synthesis tasks without high-cost external annotation.

Which all are significantly important for developing an automatic medical system.
With the aim of providing easier access for researchers, this repo contains a comprehensive paper list of Implicit Neural Representations in Medical Imaging, including papers, codes, and related websites.
We considered a sum of 86 research papers spanning from 2021 to 2023.


papers

Taxonomy

Here, we taxonomize studies that integrate implicit representations into building medical analysis models.

(Each section is ordered by the publication dates) reconstruction

Image Reconstruction


Tomography and CT

  1. πŸ“œ IntraTomo: Self-supervised Learning-based Tomography via Sinogram Synthesis and Prediction

    • πŸ—“οΈ Publication Date: 9th Feb. 2021
    • πŸ“– Proceedings: IEEE/CVF International Conference on Computer Vision, 2021
    • πŸ§‘β€πŸ”¬ Authors: Guangming Zang, Ramzi Idoughi, Rui Li, Peter Wonka, Wolfgang Heidrich
    • πŸ“„ PDF
    • πŸ“Œ Highlight: Uses coordinate-based neural representations for CT reconstructions, capturing details often overlooked by standard deep learning. It's self-supervised, using the scanned object's own projections as training data, and further refined with geometric techniques.
  2. πŸ“œ CoIL: Coordinate-based Internal Learning for Imaging Inverse Problems

    • πŸ—“οΈ Publication Date: 9th Feb. 2021
    • πŸ“– Journal: IEEE Transactions on Computational Imaging, 2021
    • πŸ§‘β€πŸ”¬ Authors: Yu Sun, Jiaming Liu, Mingyang Xie, Brendt Wohlberg, Ulugbek S. Kamilov
    • πŸ“„ PDF
    • πŸ’» GitHub
    • πŸ“Œ Highlight: Takes measurement coordinates, such as view angle ΞΈ and spatial location l in CT scans, as its input, then outputs the corresponding sensor responses for these coordinates, creating an implicit neural representation of the measurement field.
  3. πŸ“œ Dynamic CT Reconstruction from Limited Views with Implicit Neural Representations and Parametric Motion Fields

    • πŸ—“οΈ Publication Date: 23th Apr. 2021
    • πŸ“– Proceedings: IEEE/CVF International Conference on Computer Vision, 2021
    • πŸ§‘β€πŸ”¬ Authors: Albert W. Reed, Hyojin Kim, Rushil Anirudh, K. Aditya Mohan, Kyle Champley, Jingu Kang, Suren Jayasuriya
    • πŸ“„ PDF
    • πŸ“Œ Highlight: Uses implicit neural representations (INRs) for 4D-CT reconstruction. Paired with a parametric motion field, they estimate evolving 3D objects. Using a differentiable Radon transform, reconstructions are synthesized and compared with x-ray data, improving reconstruciton quality without training data.
  4. πŸ“œ Neural Computed Tomography

    • πŸ—“οΈ Publication Date: 17th Jan. 2022
    • πŸ“– Preprint: arXiv, 2022
    • πŸ§‘β€πŸ”¬ Authors: Kunal Gupta, Brendan Colvert, Francisco Contijoch
    • πŸ“„ PDF
    • πŸ’» GitHub
  5. πŸ“œ Streak artifacts reduction algorithm using an implicit neural representation in sparse-view CT

    • πŸ—“οΈ Publication Date: 4th Apr. 2022
    • πŸ“– Conference: Medical Imaging 2022: Physics of Medical Imaging, 2022
    • πŸ§‘β€πŸ”¬ Authors: Byeongjoon Kim, Hyunjung Shim, Jongduk Baek
    • πŸ“„ PDF
  6. πŸ“œ Self-Supervised Coordinate Projection Network for Sparse-View Computed Tomography

    • πŸ—“οΈ Publication Date: 12th Sep. 2022
    • πŸ“– Journal: IEEE Transactions on Computational Imaging, 2023
    • πŸ§‘β€πŸ”¬ Authors: Qing Wu, Ruimin Feng, Hongjiang Wei, Jingyi Yu, Yuyao Zhang
    • πŸ“„ PDF
    • πŸ’» GitHub
  7. πŸ“œ OReX: Object Reconstruction from Planar Cross-sections Using Neural Fields

    • πŸ—“οΈ Publication Date: 23th Nov. 2022
    • πŸ“– Conference: CVPR, 2023
    • πŸ§‘β€πŸ”¬ Authors: Haim Sawdayee, Amir Vaxman, Amit H. Bermano
    • πŸ“„ PDF
    • πŸ’» GitHub
  8. πŸ“œ NeuRec: Incorporating Interpatient prior to Sparse-View Image Reconstruction for Neurorehabilitation

    • πŸ—“οΈ Publication Date: 21th Feb. 2022
    • πŸ“– Journal: BioMed Research International, 2022
    • πŸ§‘β€πŸ”¬ Authors: Cong Liu, Qingbin Wang, Jing Zhang
    • πŸ“„ PDF
  9. πŸ“œ MEPNet: A Model-Driven Equivariant Proximal Network for Joint Sparse-View Reconstruction and Metal Artifact Reduction in CT Images.

    • πŸ—“οΈ Publication Date: 25th Jun. 2023
    • πŸ“– Preprint: arXiv
    • πŸ§‘β€πŸ”¬ Authors: Hong Wang, Minghao Zhou, Dong Wei, Yuexiang Li, Yefeng Zheng
    • πŸ“„ PDF
    • πŸ–₯️ GitHub
  10. πŸ“œ UncertaINR: Uncertainty Quantification of End-to-End Implicit Neural Representations for Computed Tomography

    • πŸ—“οΈ Publication Date: 3rd Jun. 2022
    • πŸ“– Authors: Francisca Vasconcelos, Bobby He, Nalini Singh, Yee Whye Teh
    • πŸ“„ PDF
    • πŸ’» GitHub
  11. πŸ“œ Unsupervised Polychromatic Neural Representation for CT Metal Artifact Reduction

    • πŸ—“οΈ Publication Date: 27th Jun. 2023
    • πŸ“– Preprint: arXiv
    • πŸ§‘β€πŸ”¬ Authors: Qing Wu, Lixuan Chen, Ce Wang, Hongjiang Wei, S. Kevin Zhou, Jingyi Yu, Yuyao Zhang
    • πŸ“„ PDF
  12. πŸ“œ NAISR: A 3D Neural Additive Model for Interpretable Shape Representation

    • πŸ—“οΈ Publication Date: 16th Mar. 2023
    • πŸ“– Preprint: arXiv
    • πŸ§‘β€πŸ”¬ Authors: Yining Jiao, Carlton Zdanski, Julia Kimbell, Andrew Prince, Cameron Worden, Samuel Kirse, Christopher Rutter, Benjamin Shields, William Dunn
    • πŸ“„ PDF
    • πŸ’» GitHub

Return to List


MRI

  1. πŸ“œ An Arbitrary Scale Super-Resolution Approach for 3-Dimensional Magnetic Resonance Image using Implicit Neural Representation

    • πŸ—“οΈ Publication Date: 29th Oct. 2021
    • πŸ§‘β€πŸ”¬ Authors: Qing Wu, Yuwei Li, Yawen Sun, Yan Zhou, Hongjiang Wei, Jingyi Yu, Yuyao Zhang
    • πŸ“„ PDF
    • πŸ’» GitHub
  2. πŸ“œ IREM: High-Resolution Magnetic Resonance (MR) Image Reconstruction via Implicit Neural Representation

    • πŸ—“οΈ Publication Date: 29th Jun. 2021
    • πŸ§‘β€πŸ”¬ Authors: Qing Wu, Yuwei Li, Lan Xu, Ruiming Feng, Hongjiang Wei, Qing Yang, Boliang Yu, Xiaozhao Liu, Jingyi Yu, Yuyao Zhang
    • πŸ“„ PDF
  3. πŸ“œ MRI Super-Resolution using Implicit Neural Representation with Frequency Domain Enhancement

    • πŸ—“οΈ Publication Date: Aug. 2022
    • πŸ§‘β€πŸ”¬ Authors: Shuangming Mao, Seiichiro Kamata
    • πŸ“„ PDF
  4. πŸ“œ NeSVoR: Implicit Neural Representation for Slice-to-Volume Reconstruction in MRI

    • πŸ—“οΈ Publication Date: IEEE TRANSACTIONS ON MEDICAL IMAGING, 2022
    • πŸ§‘β€πŸ”¬ Authors: Junshen Xu, Daniel Moyer, Borjan Gagoski, Juan Eugenio Iglesias, P. Ellen Grant, Polina Golland, Elfar Adalsteinsson
    • πŸ“„ PDF
    • πŸ’» GitHub
  5. πŸ“œ Spatiotemporal implicit neural representation for unsupervised dynamic MRI reconstruction

    • πŸ—“οΈ Publication Date: 31th Dec. 2022
    • πŸ§‘β€πŸ”¬ Authors: Jie Feng, Ruimin Feng, Qing Wu, Zhiyong Zhang, Yuyao Zhang, Hongjiang Wei
    • πŸ“„ [PDF](Link to PDF)
  6. πŸ“œ Neural Implicit k-Space for Binning-free Non-Cartesian Cardiac MR Imaging

    • πŸ—“οΈ Publication Date: 16th Dec. 2022
    • πŸ“– Conference: International Conference on Information Processing in Medical Imaging, 2023
    • πŸ§‘β€πŸ”¬ Authors: Wenqi Huang, Hongwei Li, Jiazhen Pan, Gastao Cruz, Daniel Rueckert, Kerstin Hammernik
    • πŸ“„ PDF
  7. πŸ“œ Continuous longitudinal fetus brain atlas construction via implicit neural representation

    • πŸ—“οΈ Publication Date: 14th Sep. 2022
    • πŸ§‘β€πŸ”¬ Authors: Lixuan Chen, Jiangjie Wu, Qing Wu, Hongjiang Wei, Yuyao Zhang
    • πŸ“„ PDF
  8. πŸ“œ Multi-contrast MRI Super-resolution via Implicit Neural Representations

    • πŸ—“οΈ Publication Date: 27th Mar. 2023
    • πŸ“– Conference: MICCAI, 2023
    • πŸ§‘β€πŸ”¬ Authors: Julian McGinnis, Suprosanna Shit, Hongwei Bran Li, Vasiliki Sideri-Lampretsa, Robert Graf, Maik Dannecker, Jiazhen Pan, Nil Stolt AnsΓΆ, Mark MΓΌhlau, Jan S. Kirschke, Daniel Rueckert, Benedikt Wiestler
    • πŸ“„ PDF
    • πŸ’» GitHub
  9. πŸ“œ Streak artifacts reduction algorithm using an implicit neural representation in sparse-view CT.

    • πŸ“… Publication Date: 4th Apr., 2022
    • πŸ“– Journal: Medical Imaging 2022: Physics of Medical Imaging, 2022
    • πŸ§‘β€πŸ”¬ Authors: Byeongjoon Kim, Hyunjung Shim, Jongduk Baek.
    • πŸ“„ PDF
  10. πŸ“œ Spatial Attention-based Implicit Neural Representation for Arbitrary Reduction of MRI Slice Spacing

    • πŸ—“οΈ Publication Date: 23rd May. 2022
    • πŸ§‘β€πŸ”¬ Authors: Xin Wang, Sheng Wang, Honglin Xiong, Kai Xuan, Zixu Zhuang, Mengjun Liu, Zhenrong Shen, Xiangyu Zhao, Lichi Zhang, Qian Wang
    • πŸ“„ PDF
    • πŸ’» GitHub
  11. πŸ“œ A scan-specific unsupervised method for parallel MRI reconstruction via implicit neural representation

    • πŸ—“οΈ Publication Date: 19th Oct. 2022
    • πŸ§‘β€πŸ”¬ Authors: Ruimin Feng, Qing Wu, Yuyao Zhang, Hongjiang Wei
    • πŸ“„ PDF
  12. πŸ“œ Dual Arbitrary Scale Super-Resolution for Multi-Contrast MRI

    • πŸ—“οΈ Publication Date: 5th Jul. 2023
    • πŸ§‘β€πŸ”¬ Authors: Jiamiao Zhang, Yichen Chi, Jun Lyu, Wenming Yang, Yapeng Tian
    • πŸ“„ PDF
    • πŸ’» GitHub
  13. πŸ“œ Unsupervised reconstruction of accelerated cardiac cine MRI using Neural Fields

    • πŸ—“οΈ Publication Date: 24th Jul. 2023
    • πŸ“– Preprint: arxiv
    • πŸ§‘β€πŸ”¬ Authors: Tabita CatalΓ‘n, MatΓ­as Courdurier, Axel Osses, RenΓ© Botnar, Francisco Sahli Costabal, Claudia Prieto
    • πŸ“„ PDF
    • πŸ’» GitHub
    • πŸ“Œ Highlight: An unsupervised INR approach that uses the spatio-temporal Fourier Features of the heart's motion.
  14. πŸ“œ Self-supervised arbitrary scale super-resolution framework for anisotropic MRI

    • πŸ—“οΈ Publication Date: 2th May. 2023
    • πŸ§‘β€πŸ”¬ Authors: Haonan Zhang, Yuhan Zhang, Qing Wu, Jiangjie Wu, Zhiming Zhen, Feng Shi, Jianmin Yuan, Hongjiang Wei, Chen Liu, Yuyao Zhang
    • πŸ“„ PDF
  15. πŸ“œ Implicit Neural Networks with Fourier-Feature Inputs for Free-breathing Cardiac MRI Reconstruction

    • πŸ—“οΈ Publication Date: 11th May. 2023
    • πŸ§‘β€πŸ”¬ Authors: Johannes F. Kunz, Stefan Ruschke, Reinhard Heckel
    • πŸ“„ PDF
    • πŸ’» GitHub
  16. πŸ“œ Implicit neural representations for unsupervised super-resolution and denoising of 4D flow MRI

    • πŸ—“οΈ Publication Date: 24th Feb. 2023
    • πŸ§‘β€πŸ”¬ Authors: Simone Saitta, Marcello Carioni, Subhadip Mukherjee, Carola-Bibiane SchΓΆnlieb, Alberto Redaelli
    • πŸ“„ PDF
  17. πŸ“œ CoNeS: Conditional neural fields with shift modulation for multi-sequence MRI translation.

    • πŸ“… Publication Date: 6th Sep., 2023
    • πŸ“– Preprint: arxiv
    • πŸ§‘β€πŸ”¬ Authors: Yunjie Chen, Marius Staring, Olaf M. Neve, Stephan R. Romeijn, Erik F. Hensen, Berit M. Verbist, Jelmer M. Wolterink, Qian Tao.
    • πŸ“„ PDF
    • πŸ’» GitHub
  18. πŸ“œ Batch Implicit Neural Representation for MRI Parallel Reconstruction.

    • πŸ“… Publication Date: 13th Sep., 2023
    • πŸ“– Preprint: arxiv
    • πŸ§‘β€πŸ”¬ Authors: Hao Li, Yusheng Zhou, Jianan Liu, Xiling Liu, Tao Huang, Zhihan Lv.
    • πŸ“„ PDF
    • πŸ“Œ Highlight: Uses INR to parametrize fully-sampled MRI images as continuous functions, enhanced by a scale-embedded encoder for scale-independent feature production.
  19. πŸ“œ 3D cine-magnetic resonance imaging using spatial and temporal implicit neural representation learning (STINR-MR).

    • πŸ“… Publication Date: 13th Sep., 2023
    • πŸ“– Preprint: arxiv
    • πŸ§‘β€πŸ”¬ Authors: Hua-Chieh Shao, Tielige Mengke, Jie Deng, and You Zhang.
    • πŸ“„ PDF
    • πŸ“Œ Highlight: The spatial implicit neural representation network maps 3D spatial coordinates to MR values, while the temporal implicit neural representation encodes time points to create dynamic motion fields

Return to List


CT and MRI

  1. πŸ“œ NeRP: Implicit Neural Representation Learning with Prior Embedding for Sparsely Sampled Image Reconstruction

    • πŸ—“οΈ Publication Date: 24th Aug. 2021
    • πŸ“– Preprint: IEEE Transactions on Neural Networks and Learning Systems, 2022
    • πŸ§‘β€πŸ”¬ Authors: Liyue Shen, John Pauly, Lei Xing.
    • πŸ“„ PDF
    • πŸ’» Github
  2. πŸ“œ CuNeRF: Cube-Based Neural Radiance Field for Zero-Shot Medical Image Arbitrary-Scale Super Resolution

    • πŸ—“οΈ Publication Date: 28th Mar. 2023
    • πŸ“– Conference: ICCV, 2023
    • πŸ§‘β€πŸ”¬ Authors: Zixuan Chen, Jianhuang Lai, Lingxiao Yang, Xiaohua Xie
    • πŸ“„ PDF

Return to List


Ultrasound

  1. πŸ“œ ImplicitVol: Sensorless 3D Ultrasound Reconstruction with Deep Implicit Representation

    • πŸ—“οΈ Publication Date: 24th Sep. 2021
    • πŸ“– Preprint: arXiv
    • πŸ§‘β€πŸ”¬ Authors: Pak-Hei Yeung, Linde Hesse, Moska Aliasi, Monique Haak, the INTERGROWTH-21st Consortium, Weidi Xie, Ana I.L. Namburete
    • πŸ“„ PDF
  2. πŸ“œ Representing 3D Ultrasound with Neural Fields

    • πŸ—“οΈ Publication Date: 21st Apr. 2022
    • πŸ“– Conference: Medical Imaging with Deep Learning, 2022
    • πŸ§‘β€πŸ”¬ Authors: Ang Nan Gu, Purang Abolmaesumi, Christina Luong, Kwang Moo Yi
    • πŸ“„ PDF
  3. πŸ“œ Going Off-Grid: Continuous Implicit Neural Representations for 3D Vascular Modeling

    • πŸ—“οΈ Publication Date: 16th Sep. 2022
    • πŸ“– Preprint: arXiv
    • πŸ§‘β€πŸ”¬ Authors: Dieuwertje Alblas, Christoph Brune, Kak Khee Yeung, Jelmer M. Wolterink
    • πŸ“„ PDF
  4. πŸ“œ Implicit Neural Representations for Breathing-compensated Volume Reconstruction in Robotic Ultrasound Aorta Screening

    • πŸ—“οΈ Publication Date: 8th Nov. 2023
    • πŸ“– Preprint: arXiv
    • πŸ§‘β€πŸ”¬ Authors: Yordanka Velikova, Mohammad Farid Azampour, Walter Simson, Marco Esposito, Nassir Navab
    • πŸ“„ PDF

Return to List


Dental and Maxillofacial

  1. πŸ“œ Topology-Preserving Shape Reconstruction and Registration via Neural Diffeomorphic Flow.

    • πŸ“… Publication Date: 16th Mar., 2022
    • πŸ“– Conference: Proceedings of the IEEE/CVF Conference on CVPR
    • πŸ§‘β€πŸ”¬ Authors: Shanlin Sun, Kun Han, Deying Kong, Hao Tang, Xiangyi Yan, Xiaohui Xie.
    • πŸ“„ PDF
    • πŸ–₯️ GitHub
  2. πŸ“œ Dynamic Cone-beam CT Reconstruction using Spatial and Temporal Implicit Neural Representation Learning (STINR).

    • πŸ“… Publication Date: Sep., 2022
    • πŸ“– Journal: Physics in Medicine and Biology, 2023
    • πŸ§‘β€πŸ”¬ Authors: You Zhang, Hua-Chieh Shao, Tinsu Pan, Tielige Mengke.
    • πŸ“„ PDF
  3. πŸ“œ Learning Deep Intensity Field for Extremely Sparse-View CBCT Reconstruction.

    • πŸ“… Publication Date: 12th Mar., 2023
    • πŸ“– Preprint: arXiv
    • πŸ§‘β€πŸ”¬ Authors: Yiqun Lin, Zhongjin Luo, Wei Zhao, Xiaomeng Li.
    • πŸ“„ PDF
    • πŸ–₯️ GitHub

Return to List


Miscellaneous

  1. πŸ“œ A Memory-Efficient Dynamic Image Reconstruction Method using Neural Fields.

    • πŸ—“οΈ Publication Date: 11th May. 2022
    • πŸ§‘β€πŸ”¬ Authors: Luke Lozenski, Mark A. Anastasio, Umberto Villa
    • πŸ“„ PDF
    • πŸ“Œ Highlight: The "Partition of Unity Network" (POUnet) is employed as a specialized neural field architecture to reconstruct dynamic biomedical images, which allows it to optimize against indirect and possibly noisy measurements, ensuring enhanced accuracy in dynamically evolving imaging scenarios.
  2. πŸ“œ Going Off-Grid: Continuous Implicit Neural Representations for 3D Vascular Modeling

    • πŸ—“οΈ Publication Date: 16th Sep. 2022
    • πŸ§‘β€πŸ”¬ Authors: Dieuwertje Alblas, Christoph Brune, Kak Khee Yeung, Jelmer M. Wolterink
    • πŸ“„ PDF
  3. πŸ“œ Implicitatlas: learning deformable shape templates in medical imaging

    • πŸ—“οΈ Publication Date: CVPR, 2022
    • πŸ§‘β€πŸ”¬ Authors: Jiancheng Yang, Udaranga Wickramasinghe, Bingbing Ni, Pascal Fua
    • πŸ“„ PDF
  4. πŸ“œ MiShape: 3D Shape Modelling of Mitochondria in Microscopy

    • πŸ—“οΈ Publication Date: 2nd Mar. 2023
    • πŸ§‘β€πŸ”¬ Authors: Abhinanda R. Punnakkal, Suyog S Jadhav, Alexander Horsch, Krishna Agarwal, Dilip K. Prasad
    • πŸ“„ PDF
  5. πŸ“œ Hybrid Neural Diffeomorphic Flow for Shape Representation and Generation via Triplane

    • πŸ—“οΈ Publication Date: 4th Jul. 2023
    • πŸ§‘β€πŸ”¬ Authors: Kun Han, Shanlin Sun, Xiaohui Xie
    • πŸ“„ PDF
  6. πŸ“œ Hybrid-CSR: Coupling Explicit and Implicit Shape Representation for Cortical Surface Reconstruction

    • πŸ—“οΈ Publication Date: 23rd Jul. 2023
    • πŸ§‘β€πŸ”¬ Authors: Shanlin Sun, Thanh-Tung Le, Chenyu You, Hao Tang, Kun Han, Haoyu Ma, Deying Kong, Xiangyi Yan, Xiaohui Xie
    • πŸ“„ PDF
  7. πŸ“œ A self-supervised learning approach for high-resolution diffuse optical tomography using neural fields.

    • πŸ—“οΈ Publication Date: 28th Jul. 2023
    • πŸ“– Conference: Proc. SPIE 12753, Second Conference on Biomedical Photonics and Cross-Fusion (BPC 2023)
    • πŸ§‘β€πŸ”¬ Authors: Linlin Li, Siyuan Shen, Shengyu Gao, Yuehan Wang, Liangtao Gu, Shiying Li, Xingjun Zhu, Jiahua Jiang, Jingyi Yu, Wuwei Ren
    • πŸ“„ PDF
    • πŸ“Œ Highlight: A diffuse optical tomography (DOT) reconstructio approach where it translates spatial coordinates to the optical absorption coefficients they correspond to.
  8. πŸ“œ INCODE: Implicit Neural Conditioning with Prior Knowledge Embeddings.

    • πŸ—“οΈ Publication Date: 28th Oct. 2023
    • πŸ“– Conference: WACV, 2024
    • πŸ§‘β€πŸ”¬ Authors: Amirhossein Kazerouni, Reza Azad, Alireza Hosseini, Dorit Merhof, Ulas Bagci
    • πŸ“„ PDF

Return to List

reconstruction
Segmentation

Image Segmentation

Brain Structures and Lesions:

  1. πŸ“œ NeRD: Neural Representation of Distribution for Medical Image Segmentation

    • πŸ“… Publication Date: 6th Mar., 2021
    • πŸ“– Preprint: arXiv, 2021
    • πŸ§‘β€πŸ”¬ Authors: Hang Zhang, Rongguang Wang, Jinwei Zhang, Chao Li, Gufeng Yang, Pascal Spincemaille, Thanh Nguyen, Yi Wang
    • πŸ“„ PDF
    • πŸ“Œ Highlight: Addresses white matter lesion segmentation and left atrial segmentation.
  2. πŸ“œ Implicit field learning for unsupervised anomaly detection in medical images

    • πŸ“… Publication Date: 9th Jun., 2021
    • πŸ“– Conference: MICCAI 2021
    • πŸ§‘β€πŸ”¬ Authors: Sergio Naval Marimont, Giacomo Tarroni
    • πŸ“„ PDF
    • πŸ“Œ Highlight: Aims to localize gliomas on brain MR images using an unsupervised out-of-distribution detection method.
  3. πŸ“œ Direct localization and delineation of human pedunculopontine nucleus based on a self-supervised magnetic resonance image super-resolution method

    • πŸ“… Publication Date: 25th Apr., 2023
    • πŸ“– Journal: Human Brain Mapping, 2023
    • πŸ§‘β€πŸ”¬ Authors: Jun Li, Xiaojun Guan, Qing Wu, Chenyu He, Weimin Zhang, Xiyue Lin, Chunlei Liu, Hongjiang Wei, Xiaojun Xu, Yuyao Zhang
    • πŸ“„ PDF
    • πŸ“Œ Highlight: Focuses on delineating the pedunculopontine nucleus (PPN).

Cardiac and Heart Structures

  1. πŸ“œ Binary segmentation of medical images using implicit spline representations and deep learning

    • πŸ“… Publication Date: 19th Mar., 2021
    • πŸ“– Journal: Computer Aided Geometric Design, 2021
    • πŸ§‘β€πŸ”¬ Authors: Oliver J.D. Barrowclough, Georg Muntingh, Varatharajan Nainamalai, Ivar Stangeby
    • πŸ“„ PDF
    • πŸ“Œ Highlight: Tackles image segmentation for a congenital heart disease computed tomography medical imaging dataset.
  2. πŸ“œ NISF: Neural Implicit Segmentation Functions

    • πŸ“… Publication Date: 15th Sep., 2023
    • πŸ“– Preprint: arXiv
    • πŸ§‘β€πŸ”¬ Authors: Nil Stolt-AnsΓ³, Julian McGinnis, Jiazhen Pan, Kerstin Hammernik, Daniel Rueckert
    • πŸ“„ PDF
    • πŸ–₯️ GitHub

Retinal Blood Vessels:

  1. πŸ“œ Retinal vessel segmentation based on self-distillation and implicit neural representation
    • πŸ“… Publication Date: 8th Nov., 2022
    • πŸ“– Journal: Applied Intelligence, 2022
    • πŸ§‘β€πŸ”¬ Authors: Jia Gu, Fangzheng Tian & Il-Seok Oh
    • πŸ“„ PDF
    • πŸ“Œ Highlight: Concentrates on segmenting retinal blood vessels from retinal images.

3D Segmentation:

  1. πŸ“œ Deep Implicit Statistical Shape Models for 3D Medical Image Delineation

    • πŸ“… Publication Date: 28th Jun., 2022
    • πŸ“– Conference: AAAI, 2022
    • πŸ§‘β€πŸ”¬ Authors: Ashwin Raju, Shun Miao, Dakai Jin, Le Lu, Junzhou Huang, Adam P. Harrison
    • πŸ“„ PDF
    • πŸ–₯️ GitHub
    • πŸ“Œ Highlight: Presents a methodology that emphasizes 3D delineation of anatomical structures using deep implicit statistical shape models.
  2. πŸ“œ Implicit Neural Representations for Medical Imaging Segmentation

    • πŸ“… Publication Date: 16th Sep., 2022
    • πŸ“– Conference: International Conference on Medical Image Computing and Computer-Assisted Intervention, 2022
    • πŸ§‘β€πŸ”¬ Authors: Muhammad Osama Khan & Yi Fang
    • πŸ“„ PDF
    • πŸ“Œ Highlight: Specifically mentions 3D signals in medical imaging, hinting at 3D anatomical structures.

Boundary Refinement:

  1. πŸ“œ Implicit Anatomical Rendering for Medical Image Segmentation with Stochastic Experts

    • πŸ“… Publication Date: 6th Apr., 2023
    • πŸ“– Preprint: arXiv, 2023
    • πŸ§‘β€πŸ”¬ Authors: Chenyu You, Weicheng Dai, Yifei Min, Lawrence Staib, James S. Duncan
    • πŸ“„ PDF
    • πŸ–₯️ GitHub
    • πŸ“Œ Highlight: Emphasizes refining the boundary regions of segmented medical images.
  2. πŸ“œ I-MedSAM: Implicit Medical Image Segmentation with Segment Anything

    • πŸ“… Publication Date: 28th Nov., 2023
    • πŸ“– Preprint: arXiv, 2023
    • πŸ§‘β€πŸ”¬ Authors: Xiaobao Wei, Jiajun Cao, Yizhu Jin, Ming Lu, Guangyu Wang, Shanghang Zhang
    • πŸ“„ PDF

Patch Level Segmentation:

  1. πŸ“œ SwIPE: Efficient and Robust Medical Image Segmentation with Implicit Patch Embeddings
    • πŸ“… Publication Date: 23rd Jul., 2023
    • πŸ“– Conference: MICCAI 2023
    • πŸ§‘β€πŸ”¬ Authors: Yejia Zhang, Pengfei Gu, Nishchal Sapkota, Danny Z. Chen
    • πŸ“„ PDF
    • πŸ“Œ Highlight: Uses implicit neural representations to predict shapes at the patch level, balancing both local boundary delineation and global shape coherence.

Return to List Segmentation
Registration

Image Registration

Deformable Registration

  1. πŸ“œ Implicit Neural Representations for Deformable Image Registration

    • πŸ“… Publication Date: 22th Jun., 2022
    • πŸ“– Conference: Medical Imaging with Deep Learning, 2022
    • πŸ§‘β€πŸ”¬ Authors: Jelmer M. Wolterink, Jesse C. Zwienenberg, Christoph Brune
    • πŸ“„ PDF
    • πŸ–₯️ GitHub
    • πŸ“Œ Highlight: Implicit deformable image registration using a neural network to represent continuous transformations
  2. πŸ“œ Learning Homeomorphic Image Registration via Conformal-Invariant Hyperelastic Regularisation

    • πŸ“… Publication Date: 30th Jun., 2023
    • πŸ“– Preprint: arXiv, 2023
    • πŸ§‘β€πŸ”¬ Authors: Jing Zou, NoΓ©mie Debroux, Lihao Liu, Jing Qin, Carola-Bibiane SchΓΆnlieb, Angelica I Aviles-Rivero
    • πŸ“„ PDF
    • πŸ“Œ Highlight: Topology-preserving deformable image registration. It discusses a novel regularizer based on conformal-invariant properties.
  3. πŸ“œ Deformable Image Registration with Geometry-informed Implicit Neural Representations

    • πŸ“… Publication Date: 13th Apr., 2023
    • πŸ“– Conference: Medical Imaging with Deep Learning, 2023
    • πŸ§‘β€πŸ”¬ Authors: Louis van Harten, Rudolf Leonardus Mirjam Van Herten, Jaap Stoker, Ivana Isgum
    • πŸ“„ PDF
    • πŸ“Œ Highlight: Parameterizes the deformation field by incorporating the geometry encoding of anatomical structures to guide the deformation process.
  4. πŸ“œ Implicit neural representations for joint decomposition and registration of gene expression images in the marmoset brain.

    • πŸ“… Publication Date: 8th Aug., 2023
    • πŸ“– Preprint: arXiv
    • πŸ§‘β€πŸ”¬ Authors: Michal Byra, Charissa Poon, Tomomi Shimogori, Henrik Skibbe
    • πŸ“„ PDF
    • πŸ“Œ Highlight: Addresses the registration of brain images with added features or artifacts by emphasizing the decomposition of images into support and residual components.
  5. πŸ“œ INR-LDDMM: Fluid-based Medical Image Registration Integrating Implicit Neural Representation and Large Deformation Diffeomorphic Metric Mapping.

    • πŸ“… Publication Date: 18th Aug., 2023
    • πŸ“– Preprint: arXiv
    • πŸ§‘β€πŸ”¬ Authors: Chulong Zhang, Xiaokun Liang
    • πŸ“„ PDF
    • πŸ“Œ Highlight: Combines implicit neural representation with Large Deformable Diffeomorphic Metric Mapping (LDDMM) in a coarse-to-fine approach.

Diffeomorphic Registration

  1. πŸ“œ Medical Image Registration via Neural Fields

    • πŸ“… Publication Date: 22th Jun., 2022
    • πŸ“– Preprint: arXiv, 2022
    • πŸ§‘β€πŸ”¬ Authors: Shanlin Sun, Kun Han, Hao Tang, Deying Kong, Junayed Naushad, Xiangyi Yan, Xiaohui Xie
    • πŸ“„ PDF
    • πŸ“Œ Highlight: Introduces a distinction between general deformable registration and diffeomorphic image registration using neural fields.
  2. πŸ“œ Diffeomorphic Image Registration with Neural Velocity Field

    • πŸ“… Publication Date: 2023
    • πŸ“– Conference: IEEE/CVF Winter Conference on Applications of Computer Vision, 2023
    • πŸ§‘β€πŸ”¬ Authors: Kun Han, Shanlin Sun, Xiangyi Yan, Chenyu You, Hao Tang, Junayed Naushad, Haoyu Ma, Deying Kong, Xiaohui Xie
    • πŸ“„ PDF
    • πŸ“Œ Highlight: Introduces a cascaded framework for diffeomorphic Image Registration with Neural Velocity Field (DNVF) by modeling the space of transformations.
  3. πŸ“œ NePhi: Neural Deformation Fields for Approximately Diffeomorphic Medical Image Registration

    • πŸ“… Publication Date: 13th Sep., 2023
    • πŸ“– Preprint: arXiv
    • πŸ§‘β€πŸ”¬ Authors: Lin Tian, Soumyadip Sengupta, Hastings Greer, RaΓΊl San JosΓ© EstΓ©par, Marc Niethammer
    • πŸ“„ PDF

Other

  1. πŸ“œ Exploring the performance of implicit neural representations for brain image registration

    • πŸ“… Publication Date: 13th Oct., 2023
    • πŸ“– Journal: Scientific Reports
    • πŸ§‘β€πŸ”¬ Authors: Michal Byra, Charissa Poon, Muhammad Febrian Rachmadi, Matthias Schlachter, Henrik Skibbe
    • πŸ“„ PDF
    • πŸ“Œ Highlight: Investigated the effectiveness of INRs in enhancing brain image registration within MRI settings
  2. πŸ“œ Dynamic Neural Fields for Learning Atlases of 4D Fetal MRI Time-series

    • πŸ“… Publication Date: 6th Nov., 2023
    • πŸ“– Conference: Medical Imaging Meets NeurIPS 2023
    • πŸ§‘β€πŸ”¬ Authors: Zeen Chi, Zhongxiao Cong, Clinton J. Wang, Yingcheng Liu, Esra Abaci Turk, P. Ellen Grant, S. Mazdak Abulnaga, Polina Golland, Neel Dey
    • πŸ“„ PDF
    • πŸ“Œ Highlight: The method is primarily focused on registration to enable motion stabilization, but it also uses a form of reconstruction to build the atlas itself from the registered data.

Return to List Registration
Neural Rendering

Neural Rendering

Reconstruction from Limited or Sparse Views

Computed Tomography (CT)

  1. πŸ“œ MedNeRF: Medical Neural Radiance Fields for Reconstructing 3D-aware CT-Projections from a Single X-ray.
    • πŸ“… Publication Date: 2nd Feb., 2022
    • πŸ“– Conference: IEEE EMBC, 2022
    • πŸ§‘β€πŸ”¬ Authors: Abril Corona-Figueroa, Jonathan Frawley, Sam Bond-Taylor, Sarath Bethapudi, Hubert P. H. Shum, Chris G. Willcocks.
    • πŸ“„ PDF
    • πŸ–₯️ Github
    • πŸ“Œ Highlight: Reconstruct CT projections from a few or a single-view X-ray, based on neural radiance fields. The proposed technique minimizes patients' exposure to ionizing radiation.

Cone Beam Computed Tomography (CBCT)

  1. πŸ“œ NAF: Neural Attenuation Fields for Sparse-View CBCT Reconstruction.

    • πŸ“… Publication Date: 29th Sep., 2022
    • πŸ“– Conference: MICCAI, 2022
    • πŸ§‘β€πŸ”¬ Authors: Ruyi Zha, Yanhao Zhang, Hongdong Li.
    • πŸ“„ PDF
    • πŸ–₯️ Github
    • πŸ“Œ Highlight: A self-supervised approach for CBCT reconstruction that requires no external training data, using a deep neural network to represent attenuation coefficients.
  2. πŸ“œ SNAF: Sparse-view CBCT Reconstruction with Neural Attenuation Fields.

    • πŸ“… Publication Date: 30th Nov., 2022
    • πŸ“– Preprint: arXiv
    • πŸ§‘β€πŸ”¬ Authors: Yu Fang, Lanzhuju Mei, Changjian Li, Yuan Liu, Wenping Wang, Zhiming Cui, Dinggang Shen.
    • πŸ“„ PDF
    • πŸ“Œ Highlight: Can reconstruct high-quality CBCT images from limited 2D projections, addressing concerns about radiation dose and image quality in dental applications.

Magnetic Resonance Imaging (MRI)

  1. πŸ“œ 3D reconstructions of brain from MRI scans using neural radiance fields.
    • πŸ“… Publication Date: 24th Apr., 2023
    • πŸ“– Preprint: arXiv
    • πŸ§‘β€πŸ”¬ Authors: Khadija Iddrisu, Sylwia Malec, Alessandro Crimi.
    • πŸ“„ PDF
    • πŸ“Œ Highlight: Uses neural radiance fields to reconstruct 3D MRI images from 2D MRI slices, aiming to reduce scan acquisition times and potential motion artifacts.

Digital Subtraction Angiography (DSA)

  1. πŸ“œ TiAVox: Time-aware Attenuation Voxels for Sparse-view 4D DSA Reconstruction.
    • πŸ“… Publication Date: 5th Sep., 2023
    • πŸ“– Preprint: arXiv
    • πŸ§‘β€πŸ”¬ Authors: Zhenghong Zhou, Huangxuan Zhao, Jiemin Fang, Dongqiao Xiang, Lei Chen, Lingxia Wu, Feihong Wu, Wenyu Liu, Chuansheng Zheng, Xinggang Wang.
    • πŸ“„ PDF
    • πŸ“Œ Highlight: A method for high-quality sparse-view 4D DSA reconstruction, reducing the required radiation dose and increasing the efficiency of 4D imaging in diagnosing vascular diseases.

Surgical Scene Reconstruction

  1. πŸ“œ Neural Rendering for Stereo 3D Reconstruction of Deformable Tissues in Robotic Surgery.

    • πŸ“… Publication Date: 30th Jun., 2022
    • πŸ“– Conference: MICCAI, 2022
    • πŸ§‘β€πŸ”¬ Authors: Yuehao Wang, Yonghao Long, Siu Hin Fan, Qi Dou.
    • πŸ“„ PDF
    • πŸ–₯️ Github
    • πŸ“Œ Highlight: Uses dynamic neural radiance fields to reconstruct deformable tissues during robotic surgery from stereo video captures
  2. πŸ“œ EndoSurf: Neural Surface Reconstruction of Deformable Tissues with Stereo Endoscope Videos.

    • πŸ“… Publication Date: 21st Jul., 2023
    • πŸ“– Conference: MICCAI 2023
    • πŸ§‘β€πŸ”¬ Authors: Ruyi Zha, Xuelian Cheng, Hongdong Li, Mehrtash Harandi, Zongyuan Ge.
    • πŸ“„ PDF
    • πŸ–₯️ Github
    • πŸ“Œ Highlight: Learns and represents a deforming surface from RGBD sequences captured via endoscope, offering improvements in high-fidelity shape reconstructions.

Ultrasound Imaging

  1. πŸ“œ Ultra-NeRF: Neural Radiance Fields for Ultrasound Imaging.
    • πŸ“… Publication Date: 25th Jan., 2023
    • πŸ“– Conference: MIDL, 2023
    • πŸ§‘β€πŸ”¬ Authors: Magdalena Wysocki, Mohammad Farid Azampour, Christine Eilers, Benjamin Busam, Mehrdad Salehi, Nassir Navab.
    • πŸ“„ PDF
    • πŸ“Œ Highlight: Introduces a physics-enhanced implicit neural representation for ultrasound imaging which accounts for view-dependent changes in appearance and geometry, improving the quality of synthesized ultrasound images.

Dental and Oral Imaging

  1. πŸ“œ Oral-NeXF: 3D Oral Reconstruction with Neural X-ray Field from Panoramic Imaging.
    • πŸ“… Publication Date: 21st Mar., 2023
    • πŸ“– Preprint: arxiv
    • πŸ§‘β€πŸ”¬ Authors: Weinan Song, Haoxin Zheng, Jiawei Yang, Chengwen Liang, Lei He.
    • πŸ“„ PDF
    • πŸ“Œ Highlight: Proposes a solution for 3D reconstruction of oral structures using a single panoramic X-ray, with a model that learns to represent the 3D oral structure implicitly

Pose Estimation

  1. πŸ“œ Robust Single-view Cone-beam X-ray Pose Estimation with Neural Tuned Tomography (NeTT) and Masked Neural Radiance Fields (mNeRF).
    • πŸ“… Publication Date: 1st Aug., 2023
    • πŸ“– Preprint: arxiv
    • πŸ§‘β€πŸ”¬ Authors: Chaochao Zhou, Syed Hasib Akhter Faruqui, Abhinav Patel, Ramez N. Abdalla, Michael C. Hurley, Ali Shaibani, Matthew B. Potts, Babak S. Jahromi, Leon Cho, Sameer A. Ansari, Donald R. Cantrell.
    • πŸ“„ PDF
    • πŸ“Œ Highlight: A method for pose estimation of radiolucent objects via X-ray projections. Two high-fidelity view synthesis methods (NeTT and mNeRF) are introduced, with NeTT being highlighted for its computational efficiency and generalization capabilities.

Return to List Neural Rendering
Compression

Image Compression

  1. πŸ“œ SCI: A Spectrum Concentrated Implicit Neural Compression for Biomedical Data.

    • πŸ“… Publication Date: 23th Nov., 2022
    • πŸ“– Conference: AAAI, 2023
    • πŸ§‘β€πŸ”¬ Authors: Runzhao Yang, Tingxiong Xiao, Yuxiao Cheng, Qianni Cao, Jinyuan Qu, Jinli Suo, Qionghai Dai.
    • πŸ“„ PDF
    • πŸ–₯️ Github
    • πŸ“Œ Highlight: Introduces an adaptive partitioning strategy to divide data into spectrum-concentrated blocks, a funnel-shaped INR structure for efficient data compression, and an allocation strategy for INR parameters.
  2. πŸ“œ TINC: Tree-structured Implicit Neural Compression.

    • πŸ“… Publication Date: 12th Nov., 2022
    • πŸ“– Preprint: arXiv
    • πŸ§‘β€πŸ”¬ Authors: Runzhao Yang, Tingxiong Xiao, Yuxiao Cheng, Jinli Suo, Qionghai Dai.
    • πŸ“„ PDF
    • πŸ–₯️ Github
    • πŸ“Œ Highlight: Uses ensemble learning and a divide-and-conquer approach to compress different regions and organizes the data using a tree structure to extract shared parameters, removing redundancy and ensuring continuity.
  3. πŸ“œ COIN++ Neural Compression Across Modalities.

    • πŸ“… Publication Date: 8th Dec ., 2022
    • πŸ“– Preprint: arXiv
    • πŸ§‘β€πŸ”¬ Authors: Emilien Dupont, Hrushikesh Loya, Milad Alizadeh, Adam GoliΕ„ski, Yee Whye Teh, Arnaud Doucet.
    • πŸ“„ PDF
    • πŸ–₯️ Github
    • πŸ“Œ Highlight: Uses meta-learning to reduce encoding time and introduces shared structures and modulation for compression across different modalities.
  4. πŸ“œ A Novel Implicit Neural Representation for Volume Data

    • πŸ—“οΈ Publication Date: 27th Feb. 2023
    • πŸ“– Journal: Applied Sciences
    • πŸ§‘β€πŸ”¬ Authors: Armin Sheibanifard, Hongchuan Yu
    • πŸ“„ PDF
    • πŸ“Œ Highlight: Introduces a new implicit neural representation to compress high-resolution medical volume data and shows high speed and quality in compression compared to existing works.
  5. πŸ“œ SINCO: A Novel structural regularizer for image compression using implicit neural representations.

    • πŸ“… Publication Date: 5th May., 2023
    • πŸ“– Conference: IEEE International Conference on Acoustics, Speech and Signal Processing, 2023
    • πŸ§‘β€πŸ”¬ Authors: Harry Gao, Weijie Gan, Zhixin Sun, Ulugbek S. Kamilov.
    • πŸ“„ PDF
    • πŸ“Œ Highlight: Uses an MLP to compress images and a segmentation network to predict segmentation masks, along with a structural regularizer to improve Dice scores between original and compressed segmentation maps.

Return to List Compression
Synthesis

Image Synthesis

  1. πŸ“œ Implicit Neural Representations for Generative Modeling of Living Cell Shapes.

    • πŸ“… Publication Date: 6th Oct., 2022
    • πŸ“– Conference: International Conference on Medical Image Computing and Computer-Assisted Intervention, 2022
    • πŸ§‘β€πŸ”¬ Authors: David Wiesner, Julian Suk, Sven Dummer, David Svoboda, Jelmer M. Wolterink.
    • πŸ“„ PDF
    • πŸ“Œ Highlight:
  2. πŸ“œ Generative modeling of living cells with SO(3)-equivariant implicit neural representations.

    • πŸ“… Publication Date: 18th Apr., 2023
    • πŸ“– Preprint: arXiv
    • πŸ§‘β€πŸ”¬ Authors: David Wiesner, Julian Suk, Sven Dummer, Tereza NečasovΓ‘, VladimΓ­r Ulman, David Svoboda, Jelmer M. Wolterink.
    • πŸ“„ PDF
    • πŸ“Œ Highlight:

Synthesis