Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Text-to-speech and other audio accomodations for blind/Visually impaired players on Windows #26885

Open
blinddevotion55 opened this issue Nov 29, 2018 · 6 comments
Labels
Accessibility Issues regarding accessibility Help Wanted Not particularly urgent or easy (see Good First Issue for this), but help is appreciated with this! Info / User Interface Game - player communication, menus, etc. (P5 - Long-term) Long-term WIP, may stay on the list for a while.

Comments

@blinddevotion55
Copy link

I am legally blind, and I enjoy this game greatly. However, due to my limited vision, I sometimes struggle to notice information as it comes up in the sidebar. I have tried using two screen-reader programs to try to read text as it appears in the sidebar, or to read descriptions of items in different inventory menus to no avail. Although a soundpack from ChestHole has hadded some audio clues, I feel the game could be made much more accessible by either adding more audio cues or increasing compatibility with screen readers or adding a basic TTS engine to the game.

Describe the solution you'd like
TTS Function:
--Needs to read off information as it appears in the sidebar. "You hear a huge explosion." for example, would be read aloud when that text appears.
--Needs to announce what sort of menu has been opened, such as the activation menu or the smart inventory, consumables, or any more specific "context menu" like for vehicles.
--Needs to read whatever text is highlighted or under the cursor when navigating windows with the arrow keys or numpad, including telling the player what key they can press to quickly access that inventory item in the future. Same thing for the look function that's bound to "x".
--Keybind to read description of an item when it comes up in the activation and inventory menus.
-----Might be unbound by default to avoid upsetting/annoying sighted players.
--separate keybind to read all the description and stats info on the page.
-----also unbound by default
--If messages related to a character's hunger, thirst, or other health do not pop up in the sidebar text scroll, add those in? (I have never seen it but I'm severely visually impared so I might have just missed it.)
--ways to convey information like weather, time of day, or health estimates if precise information isn't available to the player. For example, for daylight, "It is afternoon" or "It is sunset". For health it would be something like "Your leg is uninjured" or lightly/moderately/severely injured or crippled.

Describe alternatives you've considered
Alternative: Immersive audio clues to add to soundpack mods.
--Noises when hunger/thirst/fatigue or any other survival stat are changed. Could be a TTS thing saying "You are hungry" or a sound of a stomach growling, for example. Might need male/female sounds depending on character's sex.
--noises when new hostile creatures are seen or disappear from sight.
--Music change if a hostile mob is attempting to attack you
--A sound to alert the player if they are noticed by a mob.
--Sounds to inform the player when skills, quests, or other information updates without a message in the text flow window.

Additional context
I am attempting to use both the console and graphical tiles version with no success in using 3rd party TTS programs and screen readers. The ones I have tried are NVDA and Zoomtext.

@ZhilkinSerg ZhilkinSerg added Info / User Interface Game - player communication, menus, etc. Accessibility Issues regarding accessibility labels Nov 29, 2018
@ZhilkinSerg
Copy link
Contributor

We will try espeak for TTS.

By the way, are you playing on Windows? Both versions there are not true-console, so most (or all) screen readers would fail. Did you try console version on Linux? Screen readers should be working there.

@blinddevotion55
Copy link
Author

I'm on windows, and I'm not very skilled or even marginally proficient with Linux

@stale
Copy link

stale bot commented Aug 13, 2019

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. Please do not 'bump' or comment on this issue unless you are actively working on it. Stale issues, and stale issues that are closed are still considered.

@stale stale bot added the stale Closed for lack of activity, but still valid. label Aug 13, 2019
@alex19EP
Copy link
Contributor

hello. since I am interested in this game, and also want to make it fully accessible to blind people.
I think about the following possibilities.

  • we should focus on supporting the tiles variant since with it we get sound support.
  • we can use nvda to support accessibility for windows.
  • we need to create a separate cmdline option. to enable accessibility support and to change some interface aspects to improve non visual access.
  • we will need to create an internal screen reader for the game.

I also don’t know how good audio support is in SDL. Is 3D audio possible or at least left to right panning?

@stale stale bot removed the stale Closed for lack of activity, but still valid. label Sep 11, 2019
@stale
Copy link

stale bot commented Oct 11, 2019

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. Please do not 'bump' or comment on this issue unless you are actively working on it. Stale issues, and stale issues that are closed are still considered.

@stale stale bot added the stale Closed for lack of activity, but still valid. label Oct 11, 2019
@stale
Copy link

stale bot commented Nov 10, 2019

This issue has been automatically closed due to lack of activity. This does not mean that we do not value the issue. Feel free to request that it be re-opened if you are going to actively work on it

@stale stale bot closed this as completed Nov 10, 2019
@ZhilkinSerg ZhilkinSerg added (P5 - Long-term) Long-term WIP, may stay on the list for a while. and removed stale Closed for lack of activity, but still valid. labels Nov 10, 2019
@ZhilkinSerg ZhilkinSerg reopened this Nov 10, 2019
@NetSysFire NetSysFire added the Help Wanted Not particularly urgent or easy (see Good First Issue for this), but help is appreciated with this! label Jul 18, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Accessibility Issues regarding accessibility Help Wanted Not particularly urgent or easy (see Good First Issue for this), but help is appreciated with this! Info / User Interface Game - player communication, menus, etc. (P5 - Long-term) Long-term WIP, may stay on the list for a while.
Projects
None yet
Development

No branches or pull requests

4 participants