Terminology: Audio, System Sound, etc.

[rachaelbradley]

We need to workout some terminology for use in requirements that reference sound and audio.

Requirements

• https://www.w3.org/TR/wcag-3.0/#captions-available-prerecorded - Captions are available for all prerecorded audio content.
• Audio shifting adjustable - Audio shifting designed to create a perception of motion can be paused or turned off.
• Page/view audio adjustable - A mechanism is available to pause, stop, and adjust the volume independently of the overall system volume level, of any automatically playing audio in a page/view.
• Sounds identified in captions - Sounds needed to understand the media are identified or described in captions.
• Sound not relied on - Information is not conveyed by sound alone.
• Dialogue transcripts available (prerecorded) - Dialogue transcripts are available for all prerecorded audio and video content.

From Merriam-Webster dictionary

• Audio: The electronic representation, recording, transmission, or reproduction of sound within the range of human hearing
• Media: The plural form of medium and describes the collective means of communication—such as newspapers, radio, television, magazines, and the internet—that reach or influence a large public audience.
• Multimedia: A technique (such as the combining of sound, video, and text) for expressing ideas (as in communication, entertainment, or art) in which several media are employed.
  System sound: Not found in Merriam-Webster dictionary
  Differences
• Sound vs. Audio: Sound is the physical wave of pressure traveling through the air, while audio is how that sound is captured, converted into electrical or digital signals, and played back.
• Media refers to a single channel or format used to store and deliver information, while multimedia combines two or more of these formats into a single presentation

What terms and definitions should we use? What boundaries are needed?

[rachaelbradley]

::chair hat off:: Below are some suggested definitions

I believe we need:

• a term for all sound coming from the computer
• a term for spoken words
• a term for sounds that are not spoken words

Dialog covers spoken words. I do not think there is a generic term for sounds that are not dialog. The media industry categorizes sound as Dialog, Sound Effects, Music, and Ambient Noise. We could create a phrase to cover Sounds Effects and Music (not sure we need ambient noise) such as "non-dialog sounds" or "Sound effects & music".

My suggestion is do use phrases that match the dictionary definitions:

• Sound - Use dictionary definition, includes
• Dialog - Spoken words
• **Sound effects and music" - all non spoken words

For each of these, I also believe we need to be able to designate whether it is Live, Prerecorded, or Generated. Generated would be sound created by the computer at the point it is projected,

That would leave us with:

• Live sound, prerecorded sound, and generated sound
• Live dialog, prerecorded dialog, and generated dialog
• Live sound effects & music, prerecorded sound effects & music, and generated sound effects & music

[ashleemboyer]

Idea: Pull terms and taxonomies from Audiovisual Translation (AVT) studies, an established area with a wealth of resources (textbooks, journals, articles).

I’m exploring this currently for sign language subgroup work to outline the parameters of and the differences between sign language interpretation and translation.

Examples:

• Journal of Audiovisual Translation (JAT)
• Sign Languages in Audiovisual Media: Towards a Taxonomy from a Translational Point of View
• Audiovisual Translation by Patrick Zabalbeascoa (published 2024)

I have more to say but want to get this added while I'm thinking about it during the AGWG weekly meeting!

[iadawn]

• a term for all sound coming from the computer

System sounds

• a term for spoken words

Speech - maybe, although that has other meetings. Spoken words is ok. Bit clunky bit it does what it says on the tin.

• a term for sounds that are not spoken words

Sound effects? non speech, non spoken words

Regarding audio, media, video etc. I don't think those warrant definitions. I think the features that we refer to are more important. For example, speech or meaningful non-speech sound etc.

[lauracarlson]

Thanks for starting this discussion @rachaelbradley.

As a member of the Images & Media subgroup, I wanted to share some thoughts and personal proposals based on what we have been navigating while drafting our subgroup's media guidelines.

1. Use of "Spoken Language" Instead of "Dialogue"

While "dialogue" is a common term, another subgroup member raised an issue that we will be discussing at our next meeting: "dialogue" strictly means a conversation between two or more people.

• The Problem: If we use "Dialogue" in our titles or rules, people might think single-speaker content doesn't need a transcript. This includes presentations, lectures, monologues, training videos, and solo podcasts.
• Proposed Solution: Switch from "Dialogue" to "Spoken Language" (for example, Spoken Language Transcript Available).
• Why it helps: "Spoken Language" clearly covers any spoken content, whether it's one person talking or many, while keeping speech separate from non-spoken sounds.

2. Grouping Non-Spoken Sounds ("Non-Speech Sound")

We also need a simple term for sounds that are not spoken words.

Rather than listing just "Sound effects & music," I suggest using "non-speech sound."

• Why: Videos and audio tracks often include important sound cues beyond just music and effects (like audience laughter, door knocks, alarms, or background noise) that help explain what is happening.
• How it fits our drafts: Across our subgroup's requirements (like Sounds Identified in Transcripts), we focus on identifying non-speech sounds whenever they are needed to understand the content.

3. Suggestions for Audio, Video, and Media Definitions

This is an idea for how we can define these core media terms using plain language:

• Audio-only: Audio content that contains only sound (no video and no interaction).
• Video-only: Visual content that contains only moving pictures or images (no audio and no interaction).
• Synchronized Media: Audio and video content synced together, or synced with interactive features.
• System Sound: Sound generated by the operating system, user agent, or assistive technology (such as screen reader speech or device notifications) rather than the web content itself.

Adding "only" makes it clear when content has just sound or just visuals versus when it has both. Defining System Sound separately makes a clear boundary between author-controlled page audio and OS-level sounds that authors cannot control.

4. Suggestions for How the Media is Delivered: Prerecorded, Live, and Generated

It helps to clearly separate how content is delivered because authors have different levels of control in each case:

• Prerecorded: Audio or video content made and saved before it is played.
• Live: Information captured from a real event and sent out as it happens.
• Generated: Sound or media content created on the fly by software (such as computer-generated voices or automated sounds).

Keeping Prerecorded and Live separate in our drafts makes sure our requirements are realistic and achievable.