DeepFuse | Designing a Direct Feedback Loop between Humans and Convolutional Neural Networks through Local Explanations

Live Demo

🔎 Please zoom out the browser to 75% for the best experience: https://deepfuse-gui-demo-app-001.herokuapp.com/

Modeling Implementation

Based on the RES framework of our KDD'22 paper: RES: A Robust Framework for Guiding Visual Explanation

Codebase: https://github.com/YuyangGao/RES

Citation

Tong Steven Sun, Yuyang Gao, Shubham Khaladkar, Sijia Liu, Liang Zhao, Young-Ho Kim, and Sungsoo Ray Hong. 2023. Designing a Direct Feedback Loop between Humans and Convolutional Neural Networks through Local Explanations. Proc. ACM Hum.-Comput. Interact. 7, CSCW2, Article 338 (October 2023), 32 pages. https://doi.org/10.1145/3610187

@article{10.1145/3610187,
author = {Sun, Tong Steven and Gao, Yuyang and Khaladkar, Shubham and Liu, Sijia and Zhao, Liang and Kim, Young-Ho and Hong, Sungsoo Ray},
title = {Designing a Direct Feedback Loop between Humans and Convolutional Neural Networks through Local Explanations},
year = {2023},
issue_date = {October 2023},
publisher = {Association for Computing Machinery},
address = {New York, NY, USA},
volume = {7},
number = {CSCW2},
url = {https://doi.org/10.1145/3610187},
doi = {10.1145/3610187},
journal = {Proc. ACM Hum.-Comput. Interact.},
month = {oct},
articleno = {338},
numpages = {32},
keywords = {explainable AI (XAI), steerable AI, deepfuse, interactive attention alignment (IAA), convolutional neural network (CNN), alignable AI}
}