The code implementation of the paper Automated cephalometric landmark detection with confidence regions using Bayesian convolutional neural networks
.
The goal of this project is to locate predefined landmarks from 2D lateral cephalogram (side view X-ray of a skull), where these landmarks are utilized to diagnosis and treatment planning via various orthodontic and facial morphometric analyses. Along with achieving accruate tracing results, letting users gain access on how certain the predictions of the model are is also within the scope of this project.
The framework is mainly divided into two screening procedures: Low Resolution Screening (LRS)
and High Resolution Screening (HRS)
. We have 20 landmarks to trace, and for each landmark, both of these procedure should be done.
The objective of LRS is to create an ROI of the target landmark from the input lateral cephalogram.
a) The original lateral cephalogram gets downsampled by a factor of 3.
b) From the downsampled lat ceph, image batches are sampled with a stride of 3 mm along the width and the height direction from all over the lat ceph.
c) From the LRS calculation, CNN model provides a region of interest for the target landmark to be located in.
The objective of HRS is to estimate the exact location of the landmark with the uncertainty from the ROI from LRS.
d) Every single pixel from the ROI is, again, sampled as an image batch to be put into Bayesian CNN(B-CNN) model for iterative calculations.
e) HRS provides the final predicted target position for the target landmark.
Error (mm) | SDR (%) | |||||
---|---|---|---|---|---|---|
Mean | SD | 2mm | 2.5mm | 3mm | 4mm | |
Sella | 0.86 | 1.92 | 96.67 | 97.33 | 98.00 | 98.00 |
Nasion | 1.28 | 1.03 | 81.33 | 86.00 | 90.00 | 96.67 |
Orbitale | 2.11 | 2.77 | 77.33 | 87.33 | 94.00 | 96.67 |
Porion | 1.89 | 1.67 | 58.00 | 66.00 | 72.67 | 86.67 |
A-point | 2.07 | 2.53 | 52.00 | 62.00 | 74.00 | 87.33 |
B-point | 2.08 | 1.77 | 79.33 | 88.67 | 93.33 | 96.67 |
Pogonion | 1.17 | 0.81 | 82.67 | 90.67 | 96.00 | 100.00 |
Menton | 1.11 | 2.82 | 95.33 | 97.33 | 98.00 | 98.67 |
Gnathion | 0.97 | 0.56 | 92.00 | 97.33 | 98.67 | 98.67 |
Gonion | 2.39 | 4.77 | 63.33 | 75.33 | 85.33 | 92.67 |
Lower incisal incision | 1.35 | 2.19 | 84.00 | 90.67 | 93.33 | 96.67 |
Upper incisal incision | 0.90 | 0.75 | 93.33 | 97.33 | 98.00 | 99.33 |
Upper lip | 1.32 | 0.83 | 96.67 | 100.00 | 100.00 | 100.00 |
Lower lip | 1.28 | 0.85 | 97.33 | 98.67 | 98.67 | 99.33 |
Subnasale | 1.22 | 1.56 | 84.00 | 92.00 | 95.33 | 96.67 |
Soft tissue pogonion | 2.62 | 2.07 | 82.67 | 92.67 | 95.33 | 97.33 |
Posterior Nasal Spine | 1.23 | 0.91 | 90.00 | 94.00 | 95.33 | 98.00 |
Anterior Nasal Spine | 1.52 | 1.56 | 78.67 | 87.33 | 90.67 | 93.33 |
Articulare | 1.70 | 1.77 | 75.33 | 83.33 | 86.67 | 90.67 |
Average | 1.53 | 1.74 | 82.11 | 88.63 | 92.28 | 95.96 |
Diagonal accuracy | |||||||
---|---|---|---|---|---|---|---|
Proposed | Lindner et al. | Arik et al. | |||||
ANB | Pred 1 | Pred 2 | Pred 3 | 80.72 | 79.90 | 77.31 | |
True 1 | 65.75 | 10.96 | 23.29 | ||||
True 2 | 23.64 | 70.91 | 5.45 | ||||
True 3 | 4.96 | 0.83 | 94.21 | ||||
SNB | Pred 1 | Pred 2 | Pred 3 | 83.13 | 78.80 | 70.11 | |
True 1 | 73.24 | 4.23 | 22.54 | ||||
True 2 | 38.46 | 58.97 | 2.56 | ||||
True 3 | 5.04 | 0.00 | 94.96 | ||||
SNA | Pred 1 | Pred 2 | Pred 3 | 72.69 | 73.81 | 66.72 | |
True 1 | 67.62 | 16.19 | 16.19 | ||||
True 2 | 18.89 | 80.00 | 1.11 | ||||
True 3 | 25.93 | 3.70 | 70.37 | ||||
ODI | Pred 1 | Pred 2 | Pred 3 | 81.53 | 81.75 | 75.04 | |
True 1 | 82.1482.14 | 6.25 | 11.61 | ||||
True 2 | 33.33 | 66.67 | 0.00 | ||||
True 3 | 15.55 | 0.91 | 85.55 | ||||
APDI | Pred 1 | Pred 2 | Pred 3 | 84.34 | 89.26 | 87.18 | |
True 1 | 82.14 | 6.25 | 11.61 | ||||
True 2 | 33.33 | 66.67 | 0.00 | ||||
True 3 | 15.55 | 0.91 | 85.55 | ||||
FHI | Pred 1 | Pred 2 | Pred 3 | 84.74 | 63.51 | 69.16 | |
True 1 | 82.14 | 6.25 | 11.61 | ||||
True 2 | 33.33 | 66.67 | 0.00 | ||||
True 3 | 15.55 | 0.91 | 85.55 | ||||
FMA | Pred 1 | Pred 2 | Pred 3 | 81.93 | 81.92 | 78.01 | |
True 1 | 82.14 | 6.25 | 11.61 | ||||
True 2 | 33.33 | 66.67 | 0.00 | ||||
True 3 | 15.55 | 0.91 | 85.55 | ||||
MW | Pred 1 | Pred 3 | Pred 4 | Pred 5 | 80.32 | 79.59 | 81.31 |
True 1 | 75.00 | 1.19 | 17.86 | 5.95 | |||
True 3 | 0.00 | 89.76 | 2.04 | 8.16 | |||
True 4 | 13.89 | 0.00 | 86.11 | 0.00 | |||
True 5 | 15.91 | 13.64 | 0.00 | 70.45 |
The dataset from ISBI is not included in this repo. You can find it here
Please use the following bibtex for citations:
@article{lee2020automated,
title={Automated cephalometric landmark detection with confidence regions using Bayesian convolutional neural networks},
author={Lee, Jeong-Hoon and Yu, Hee-Jin and Kim, Min-ji and Kim, Jin-Woo and Choi, Jongeun},
journal={BMC oral health},
volume={20},
number={1},
pages={1--10},
year={2020},
publisher={Springer}
}