A website for automatically diagnosing chest x-rays using generated radiologist reports and patient information.
- Using approximately 8% of the MIMIC-CXR dataset for training and evaluating on the official test set, the report generation model achieves a Bleu4 score of 0.0704 and the diagnosis model achieves a PR-AUC score of .7688, 54.49% precision, 82.41% recall, and an F2 score of .733. Metrics such as accuracy and ROC AUC were avoided in the optimization of the model and in their reporting because of the dataset's imbalance between positive and negative examples for each condition. A state-of-the-art model to compare these metrics to can be found here.
- Inference finishes within 3-6 minutes, depending on the number of views and x-rays provided.
- fast.ai for their model training code.
- Shenzhen Research Institute of Big Data for their radiologist report generation model.
- Zachary Mueller for his ideas around multi-modal model training.
- Binder for their repository hosting platform.