Repository navigation
Talking Tactile turns a printed STEM figure into a raised sheet that a blind student explores by touch, with a phone that names each part and answers questions about that figure, built on Muse Spark, SAM 3.1 and Muse Voice Transcribe.
Demo video (3 minutes): https://www.youtube.com/watch?v=t0WsLi3jYXY
Project site: https://deepakkts.github.io/talking-tactile/
Measured: questions answered from the right source, 36 of 38 on the heart and 35 of 35 on the brain (eval/qa/RESULTS.md); fingertip error on the iPhone, mean 7.93 mm, median 4.0 mm, p95 25.77 mm against a 4 mm target (eval/gate-b/RESULTS.md).
Known limits: not yet tested with blind students or teachers, the touch test missed its target, questions need the network and take about 5 s on a Mac, and latency on the phone was not measured.