We used existing implementations of the ALBEF model for our multimodal lesion classification available at Multimodal-Learning-Hands-on-Tutorial/multimodal_training.ipynb
- Abdulmateen Adebiyi, Nader Abdalnabi, Emily Smith Hoffman, Jesse Hirner, Eduardo J. Simoes, Mirna Becevic, Praveen Rao. Accurate Skin Lesion Classification Using Multimodal Learning on the HAM10000 and ISIC 2017 Datasets. MedRxiv, 2024.05.30.24308213, 2025.
- Abdulmateen Adebiyi, Nader Abdalnabi, Emily Smith Hoffman, Jesse Hirner, Eduardo J. Simoes, Mirna Becevic, Praveen Rao. Accurate Skin Lesion Classification Using Multimodal Learning on the HAM10000 and ISIC 2017 Datasets. AMIA Amplify Informatics Conference, 2026. (poster, to appear)
This project was funded by the Translational Research Informing Useful and Meaningful Precision Health (TRIUMPH) grant from the University of Missouri-Columbia.