Accessibility: Recognize text in games and output to VoiceOver

[devinprater]

Delta could be the first emulator that helps blind people enjoy older games. For most fighting games, text recognition, for menus and such, are all that is needed to play, and in some cases, complete games. To do this, a key command, for keyboards, Controller button, for game pads (the Menu key maybe, pressed three times quickly?), or gesture could be made, triggerable when Delta detects that VoiceOver is on, to do the following:
First, OCR the game screen, with This framework
Then, speak the output text, preferably with VoiceOver, either by sending it directly to VoiceOver, or by showing an alert with the text and an OK button to dismiss it, or with the AV Speech Synthesizer with a way to stop speech after it has begun.
That's pretty much all I, personally, would need. Also, a way to open the menu to save state, quit game, load state, and all that would be good too, implemented on the touch screen with the Magic Tap to open the menu, and the Menu button on controllers to do the same thing.

Thanks for anything that comes of this. I know quite a few blind people who would love having an emulator on iOS that is accessible to us.

[devinprater]

You could use this OCR applet to see how the flow of things could work with this.