- About
- Hardware Requirements
- Installation (command-line based)
- Installation (3D Slicer extension)
- Installation (browser based)
- Download Data
- Revisions
- Smart Interpolation
- Deep Learning
- Particle Segmentation
- Mesh Generator
- Biomedisa Features
- Authors
- FAQ
- Citation
- License
Biomedisa (https://biomedisa.info) is a free and easy-to-use open-source application for segmenting large 3D volumetric images such as CT and MRI scans, developed at The Australian National University CTLab. Biomedisa's smart interpolation of sparsely pre-segmented slices enables accurate semi-automated segmentation by considering the complete underlying image data. Additionally, Biomedisa enables deep learning for fully automated segmentation across similar samples and structures. It is compatible with segmentation tools like Amira/Avizo, ImageJ/Fiji, and 3D Slicer.
Lösel, P. D. et al. Introducing Biomedisa as an open-source online platform for biomedical image segmentation. Nat. Commun. 11, 5577 (2020). https://doi.org/10.1038/s41467-020-19303-w
- One or more NVIDIA, AMD, or Intel GPUs
- Ubuntu 22/24 + Smart Interpolation
- Ubuntu 22/24 + Deep Learning
- Ubuntu 22/24 + Smart Interpolation + Deep Learning
- Windows 10/11 + Smart Interpolation + Deep Learning
- Download test data from our gallery
from biomedisa.features.biomedisa_helper import load_data, save_data
from biomedisa.interpolation import smart_interpolation
# load data
img, _ = load_data('Downloads/trigonopterus.tif')
labels, header = load_data('Downloads/labels.trigonopterus_smart.am')
# run smart interpolation with optional smoothing result
results = smart_interpolation(img, labels, smooth=100)
# get results
regular_result = results['regular']
smooth_result = results['smooth']
# save results
save_data('Downloads/final.trigonopterus.am', regular_result, header=header)
save_data('Downloads/final.trigonopterus.smooth.am', smooth_result, header=header)python -m biomedisa.interpolation C:\Users\%USERNAME%\Downloads\tumor.tif C:\Users\%USERNAME%\Downloads\labels.tumor.tif
If pre-segmentation is not exclusively in the XY plane:
python -m biomedisa.interpolation C:\Users\%USERNAME%\Downloads\tumor.tif C:\Users\%USERNAME%\Downloads\labels.tumor.tif --allaxis
from biomedisa.features.biomedisa_helper import load_data
from biomedisa.deeplearning import deep_learning
# load image data
img1, _ = load_data('Head1.am')
img2, _ = load_data('Head2.am')
img_data = [img1, img2]
# load label data and header information to be stored in the network file (optional)
label1, _ = load_data('Head1.labels.am')
label2, header, ext = load_data('Head2.labels.am',
return_extension=True)
label_data = [label1, label2]
# load validation data (optional)
img3, _ = load_data('Head3.am')
img4, _ = load_data('Head4.am')
label3, _ = load_data('Head3.labels.am')
label4, _ = load_data('Head4.labels.am')
val_img_data = [img3, img4]
val_label_data = [label3, label4]
# deep learning
deep_learning(img_data, label_data, train=True, batch_size=12,
val_img_data=val_img_data, val_label_data=val_label_data,
header=header, extension=ext, path_to_model='honeybees.h5')python -m biomedisa.deeplearning C:\Users\%USERNAME%\Downloads\training_heart C:\Users\%USERNAME%\Downloads\training_heart_labels -t
Monitor training progress using validation data:
python -m biomedisa.deeplearning C:\Users\%USERNAME%\Downloads\training_heart C:\Users\%USERNAME%\Downloads\training_heart_labels -t -vi=C:\Users\%USERNAME%\Downloads\val_img -vl=C:\Users\%USERNAME%\Downloads\val_labels
If running into ResourceExhaustedError due to out of memory (OOM), try to use a smaller batch size (e.g. -bs=12).
from biomedisa.features.biomedisa_helper import load_data, save_data
from biomedisa.deeplearning import deep_learning
# load data
img, _ = load_data('Head5.am')
# deep learning
results = deep_learning(img, predict=True,
path_to_model='honeybees.h5', batch_size=6)
# save result
save_data('final.Head5.am', results['regular'], results['header'])python -m biomedisa.deeplearning C:\Users\%USERNAME%\Downloads\testing_axial_crop_pat13.nii.gz C:\Users\%USERNAME%\Downloads\heart.h5
Checkout the preprint for more information. Download a test dataset from the paper (downsampled by a factor of 4):
wget https://biomedisa.info/media/images/large_particles_rescan_0_x4.tif
wget https://biomedisa.info/media/images/mask.large_particles_rescan_0_x4.tif
Download a pretrained model:
wget https://biomedisa.info/media/Quartz/model_svl_step=2.h5
Instance segmentation of individual particles using implicit boundary detection:
python -m biomedisa.deeplearning large_particles_rescan_0_x4.tif model_svl_step=2.h5 --mask mask.large_particles_rescan_0_x4.tif
Install SAM:
python -m pip install git+https://github.com/facebookresearch/segment-anything.git
Download a pretrained model:
wget https://dl.fbaipublicfiles.com/segment_anything/sam_vit_l_0b3195.pth
Instance segmentation of individual particles:
python -m biomedisa.deeplearning large_particles_rescan_0_x4.tif sam_vit_l_0b3195.pth --mask mask.large_particles_rescan_0_x4.tif
Create STL mesh from segmentation (label values are saved as attributes)
from biomedisa.features.biomedisa_helper import load_data, save_data
from biomedisa.mesh import get_voxel_spacing, save_mesh
# load segmentation
data, header, extension = load_data('final.Head5.am', return_extension=True)
# get voxel spacing
x_res, y_res, z_res = get_voxel_spacing(header, extension)
print(f'Voxel spacing: x_spacing, y_spacing, z_spacing = {x_res}, {y_res}, {z_res}')
# save stl file
save_mesh('final.Head5.stl', data, x_res, y_res, z_res, poly_reduction=0.9, smoothing_iterations=15)python -m biomedisa.mesh 'final.Head5.am'
For DICOM, PNG files, or similar formats, file path must reference either a directory or a ZIP file containing the image slices.
from biomedisa.features.biomedisa_helper import load_data, save_data
# load data as numpy array
data, header = load_data('temp.tif')
# save data (for TIFF, header=None)
save_data('temp.tif', data, header)from biomedisa.features.biomedisa_helper import img_resize
# resize image data
zsh, ysh, xsh = data.shape
new_zsh, new_ysh, new_xsh = zsh//2, ysh//2, xsh//2
data = img_resize(data, new_zsh, new_ysh, new_xsh)
# resize label data
label_data = img_resize(label_data, new_zsh, new_ysh, new_xsh, labels=True)from biomedisa.features.biomedisa_helper import clean, fill
# delete outliers smaller than 90% of the segment
label_data = clean(label_data, 0.9)
# fill holes
label_data = fill(label_data, 0.9)from biomedisa.features.biomedisa_helper import Dice_score, ASSD
dice = Dice_score(ground_truth, result)
assd = ASSD(ground_truth, result)- Philipp D. Lösel
See also the list of contributors who participated in this project.
Frequently asked questions can be found at: https://biomedisa.info/faq/.
If you use Biomedisa or the data, please cite the following paper:
Lösel, P. D. et al. Introducing Biomedisa as an open-source online platform for biomedical image segmentation. Nat. Commun. 11, 5577 (2020). https://doi.org/10.1038/s41467-020-19303-w
If you use Biomedisa's Deep Learning, you may also cite:
Lösel, P. D. et al. Natural variability in bee brain size and symmetry revealed by micro-CT imaging and deep learning. PLoS Comput. Biol. 19, e1011529 (2023). https://doi.org/10.1371/journal.pcbi.1011529
If you use Biomedisa's Smart Interpolation, you can also cite the initial description of this method:
Lösel, P. & Heuveline, V. Enhancing a diffusion algorithm for 4D image segmentation using local information. Proc. SPIE 9784, 97842L (2016). https://biomedisa.info/media/97842L.pdf
If you use Biomedisa's Particle Separation or Self-Validated Learning, please cite the following preprint:
Lösel, P. D. et al. Self-validated learning for particle separation: A correctness-based self-training framework without human labels. Preprint at https://doi.org/10.48550/arXiv.2508.16224 (2025).
This project is covered under the EUROPEAN UNION PUBLIC LICENCE v. 1.2 (EUPL).