Redesign A/V settings to maintain a transient state of connected clients, their muted/hidden status, and their currently speaking status.

[aaclayton]

This would allow for a few things:

1. Display a muted/hidden icon for all users when a user mutes themselves.
2. Only process audio levels of your own local master stream and simply obtain an "is speaking" indicator from the socket.

[aaclayton]

marked this issue as related to #3328

[aaclayton]

marked this issue as related to #3570

[aaclayton]

Originally in GitLab by @bekit

I like this plan. I'm already bypassing the Foundry "is speaking" logic with the JitsiRTC module and manually setting the indicator using Jitsi's API-based audio level detection. (_onTrackAudioLevelChanged)

I'm in favor of having this be something that is manually triggered by the AVClient so native detection can be used easier.

[aaclayton]

Originally in GitLab by @anathemamask

Commented on by @bekit in #5743

Feature Summary

It would be nice to be able to see if a user has their A/V muted or if they have PTT enabled. Currently these settings are only stored in the local client settings store, so they can't be read by other users. This would help to debug why a user isn't able to be heard or seen in an A/V session.

User Experience

Ideally, the settings will be made available under the settings store so something like the following could be called:

if (game.webrtc.client.settings.getUser("someuserid").voiceMode === "activity") {...}

In addition to this, having additional indicators on the user camera view notification-bar element would be helpful for displaying state. Suggested elements:

<i class="fas fa-podcast fa-fw status-remote-ptt hidden" title="${game.i18n.localize("WEBRTC.VoiceModePtt")}"></i>
<i class="fas fa-microphone-alt-slash fa-fw status-remote-muted hidden" title="${game.i18n.localize("WEBRTC.IndicatorMuted")}"></i>
<i class="fas fa-eye-slash fa-fw status-remote-hidden hidden" title="${game.i18n.localize("WEBRTC.IndicatorHidden")}"></i>

The status-remote-ptt indicator could be visible when the user is set to PTT mode and lit green when actively broadcasting.

Priority/Importance

Nice to have. This could be done strictly through modules, and I may do so, but it'd be nice to have it built in to foundry.