TotalVibeSegmentator: Full Torso Segmentation for the NAKO and UK Biobank in Volumetric Interpolated Breath-hold Examination Body Images
- Nvidia-GPU with 4 GB of RAM or more.
- A newer Mac with M2/M3 could work, but we could not test this.
- Python 3.10 or higher.
- Open a command line (search for Terminal on Mac or cmd on Windows in your OS search).
- Ensure you have Anaconda (Python) installed.
- Navigate to the folder where you want to download the script using
cd [FOLDER PATH].
# Run this commands by coping in to the Terminal
# Recommended: make a virtual Python environment (example shows Anaconda)
conda create -n "TotalVibeSegmentator" python=3.11.0
conda activate TotalVibeSegmentator
# Install PyTorch that works with your GPU (follow instructions at https://pytorch.org/get-started/locally/)
pip install torch torchvision torchaudio
# Install required Python packages
pip install TPTBox ruamel.yaml configargparse
pip install nnunetv2
# If nnunetv2 does not work, try version 2.4.2
# Uninstall the current version and reinstall with the specified version
#pip uninstall nnunetv2
#pip install nnunetv2==2.4.2
# Download the scripts (they will be downloaded to your current folder)
git clone https://github.com/robert-graf/TotalVibeSegmentator.git
cd TotalVibeSegmentatorDownload the nnUNet weights automatically. They are put in [Path to this project]/nnUNet/nnUNet_results/.
# Run this commands in a Terminal where you navigate to the folder where `run_TotalVibeSegmentator.py` is
conda activate TotalVibeSegmentator
# Total Segmentation
python run_TotalVibeSegmentator.py --img [IMAGE-PATH] --out_path [OUTPATH] --roi_path [roi_out_path (optional)]
# Total Segmentation with postprocessing and combining of masks
python run_TotalVibeSegmentator_multi.py --img_inphase [IMAGE-PATH] --img_water [IMAGE-PATH] --img_outphase [IMAGE-PATH] --out_path [OUTPATH] --roi_path [roi_out_path (optional)]
# Spine Instance
python run_instance_spine_segmentation.py --img [IMAGE-PATH] --out_path [OUTPATH]
# Spine Semantic
python run_semantic_spine_segmentation.py --img [IMAGE-PATH] --out_path [OUTPATH]
| ID | NAME |
|---|---|
| 1 | spleen |
| 2 | kidney_right |
| 3 | kidney_left |
| 4 | gallbladder |
| 5 | liver |
| 6 | stomach |
| 7 | pancreas |
| 8 | adrenal_gland_right |
| 9 | adrenal_gland_left |
| 10 | lung_upper_lobe_left |
| 11 | lung_lower_lobe_left |
| 12 | lung_upper_lobe_right |
| 13 | lung_middle_lobe_right |
| 14 | lung_lower_lobe_right |
| 15 | esophagus |
| 16 | trachea |
| 17 | thyroid_gland |
| 18 | intestine |
| 19 | duodenum |
| 20 | unused |
| 21 | urinary_bladder |
| 22 | prostate |
| 23 | sacrum |
| 24 | heart |
| 25 | aorta |
| 26 | pulmonary_vein |
| 27 | brachiocephalic_trunk |
| 28 | subclavian_artery_right |
| 29 | subclavian_artery_left |
| 30 | common_carotid_artery_right |
| 31 | common_carotid_artery_left |
| 32 | brachiocephalic_vein_left |
| 33 | brachiocephalic_vein_right |
| 34 | atrial_appendage_left |
| 35 | superior_vena_cava |
| 36 | inferior_vena_cava |
| 37 | portal_vein_and_splenic_vein |
| 38 | iliac_artery_left |
| 39 | iliac_artery_right |
| 40 | iliac_vena_left |
| 41 | iliac_vena_right |
| 42 | humerus_left |
| 43 | humerus_right |
| 44 | scapula_left |
| 45 | scapula_right |
| 46 | clavicula_left |
| 47 | clavicula_right |
| 48 | femur_left |
| 49 | femur_right |
| 50 | hip_left |
| 51 | hip_right |
| 52 | spinal_cord |
| 53 | gluteus_maximus_left |
| 54 | gluteus_maximus_right |
| 55 | gluteus_medius_left |
| 56 | gluteus_medius_right |
| 57 | gluteus_minimus_left |
| 58 | gluteus_minimus_right |
| 59 | autochthon_left |
| 60 | autochthon_right |
| 61 | iliopsoas_left |
| 62 | iliopsoas_right |
| 63 | sternum |
| 64 | costal_cartilages |
| 65 | subcutaneous_fat |
| 66 | muscle |
| 67 | inner_fat |
| 68 | IVD |
| 69 | vertebra_body |
| 70 | vertebra_posterior_elements |
| 71 | spinal_channel |
| 72 | bone_other |
You can select older (or new if your code is not updated with git pull) versions with --dataset_id [ID]
| ID | NAME |
|---|---|
| 80 | publication version |
| 85 | preprint version |
| 86 | repaired stomach (deprecated) |
| 87 | better hyperparameter (deprecated) |
| 278 | Splits the body in 11 regions |
The related paper is available as preprint: arXiv:2406.00125
@article{graf2024totalvibesegmentator,
title={TotalVibeSegmentator: Full Torso Segmentation for the NAKO and UK Biobank in Volumetric Interpolated Breath-hold Examination Body Images},
author={Graf, Robert and Platzek, Paul-S{\"o}ren and Riedel, Evamaria Olga and Ramsch{\"u}tz, Constanze and Starck, Sophie and M{\"o}ller, Hendrik Kristian and Atad, Matan and V{\"o}lzke, Henry and B{\"u}low, Robin and Schmidt, Carsten Oliver and others},
journal={arXiv preprint arXiv:2406.00125},
year={2024}
}
run_TotalVibeSegmentator.py [...] --dataset_id 278
