multi channel stereo support for audio

[JaenalLeeGenMao]

Have you read the FAQ and checked for duplicate open issues?
yes

Is your feature request related to a problem? Please describe.

I am facing a problem where the stream contains 8 audio channels a multichannel stereo, the player most of the time plays without audio or occasionally returns error 3016 PIPELINE_ERROR_DECODE: Failed to send audio packet_6 duration=0 size=256 is_key_frame=1 encrypted=0

Describe the solution you'd like

it should play along with the audio with the min bandwidth

Describe alternatives you've considered

I have tested in shaka version 2.5.13 and stereo works fine but multichannel stereo either plays the video without audio or returns error (should've support a nice thing to have options to select audio)

Additional context

Audio 8 channel << playable without audio
https://cdn-mola-primary-01.akamaized.net/Content/DASH/VOD/18544/12476/6c5df5d3-e5f2-4ced-913c-87e8e70da2cc/66484355-ae63-ece2-716f-643a4e39e54d/manifest_L2.mpd?hdnts=st=1602150006~exp=1602153606~acl=/*~hmac=c3b6c911c227c63badc42c5d99889d2c31b1a1a922d4cbc7195fa2639c8cefa4

Audio 2 channel << playable with audio
https://cdn-mola-primary-01.akamaized.net/Content/DASH/VOD/8634/578/1a7bf651-db53-49f6-89f5-d205811bf3eb/66484355-ae63-ece2-716f-643a4e39e54d/manifest_L2.mpd?hdnts=st=1602150223~exp=1602153823~acl=/*~hmac=ebc5c6ab42a31cb202d3bbcfda37108bf7cbe2c3282607109183db2deffb3480

Error with multichannel stereo of audio 8 channel

General info of multichannel for audio 8 channel

General
Complete name              : C:\Users\user\AppData\Local\Temp\16020940814350\MOSHBDL0029-BUNDESLIGA HL 2021--FC Bayern München - Hertha Berlin IM.mxf
Format                  : MXF
Commercial name             : XDCAM HD422
Format version              : 1.2
Format profile              : OP-1a
Format settings             : Closed / Complete
File size                : 879 MiB
Duration                 : 2 min 3 s
Overall bit rate             : 60.0 Mb/s
Package name               : Source Package
Encoded date               : 2020-10-04 18:50:23.000
Writing application           : Adobe Systems Incorporated Premiere Pro 1.0.0.0.1
Writing library             : Mac OS X 5.0.15.0.1
Video
ID                    : 512
Format                  : MPEG Video
Commercial name             : XDCAM HD422
Format version              : Version 2
Format profile              : 4:2:2@High
Format settings             : CustomMatrix / BVOP
Format settings, BVOP          : Yes
Format settings, Matrix         : Custom
Format settings, GOP           : M=3, N=12
Format settings, picture structure    : Frame
Format settings, wrapping mode      : Frame
Codec ID                 : 0D01030102046001-0401020201040300
Duration                 : 2 min 3 s
Bit rate mode              : Constant
Bit rate                 : 50.0 Mb/s
Width                  : 1 920 pixels
Height                  : 1 080 pixels
Display aspect ratio           : 16:9
Frame rate                : 25.000 FPS
Standard                 : Component
Color space               : YUV
Chroma subsampling            : 4:2:2
Bit depth                : 8 bits
Scan type                : Interlaced
Scan order                : Top Field First
Compression mode             : Lossy
Bits/(Pixel*Frame)            : 0.965
Time code of first frame         : 00:00:00:00
Time code source             : Group of pictures header
Stream size               : 733 MiB (83%)
Color range               : Limited
Color primaries             : BT.709
Transfer characteristics         : BT.709
Audio #1
ID                    : 768
Format                  : PCM
Format settings             : Little
Format settings, wrapping mode      : Frame (AES)
Codec ID                 : 0D01030102060300
Duration                 : 2 min 3 s
Bit rate mode              : Constant
Bit rate                 : 1 152 kb/s
Channel(s)                : 1 channel
Sampling rate              : 48.0 kHz
Frame rate                : 25.000 FPS (1920 SPF)
Bit depth                : 24 bits
Stream size               : 16.9 MiB (2%)
Locked                  : Yes
Audio #2
ID                    : 1024
Format                  : PCM
Format settings             : Little
Format settings, wrapping mode      : Frame (AES)
Codec ID                 : 0D01030102060300
Duration                 : 2 min 3 s
Bit rate mode              : Constant
Bit rate                 : 1 152 kb/s
Channel(s)                : 1 channel
Sampling rate              : 48.0 kHz
Frame rate                : 25.000 FPS (1920 SPF)
Bit depth                : 24 bits
Stream size               : 16.9 MiB (2%)
Locked                  : Yes
Audio #3
ID                    : 1280
Format                  : PCM
Format settings             : Little
Format settings, wrapping mode      : Frame (AES)
Codec ID                 : 0D01030102060300
Duration                 : 2 min 3 s
Bit rate mode              : Constant
Bit rate                 : 1 152 kb/s
Channel(s)                : 1 channel
Sampling rate              : 48.0 kHz
Frame rate                : 25.000 FPS (1920 SPF)
Bit depth                : 24 bits
Stream size               : 16.9 MiB (2%)
Locked                  : Yes
Audio #4
ID                    : 1536
Format                  : PCM
Format settings             : Little
Format settings, wrapping mode      : Frame (AES)
Codec ID                 : 0D01030102060300
Duration                 : 2 min 3 s
Bit rate mode              : Constant
Bit rate                 : 1 152 kb/s
Channel(s)                : 1 channel
Sampling rate              : 48.0 kHz
Frame rate                : 25.000 FPS (1920 SPF)
Bit depth                : 24 bits
Stream size               : 16.9 MiB (2%)
Locked                  : Yes
Audio #5
ID                    : 1792
Format                  : PCM
Format settings             : Little
Format settings, wrapping mode      : Frame (AES)
Codec ID                 : 0D01030102060300
Duration                 : 2 min 3 s
Bit rate mode              : Constant
Bit rate                 : 1 152 kb/s
Channel(s)                : 1 channel
Sampling rate              : 48.0 kHz
Frame rate                : 25.000 FPS (1920 SPF)
Bit depth                : 24 bits
Stream size               : 16.9 MiB (2%)
Locked                  : Yes
Audio #6
ID                    : 2048
Format                  : PCM
Format settings             : Little
Format settings, wrapping mode      : Frame (AES)
Codec ID                 : 0D01030102060300
Duration                 : 2 min 3 s
Bit rate mode              : Constant
Bit rate                 : 1 152 kb/s
Channel(s)                : 1 channel
Sampling rate              : 48.0 kHz
Frame rate                : 25.000 FPS (1920 SPF)
Bit depth                : 24 bits
Stream size               : 16.9 MiB (2%)
Locked                  : Yes
Audio #7
ID                    : 2304
Format                  : PCM
Format settings             : Little
Format settings, wrapping mode      : Frame (AES)
Codec ID                 : 0D01030102060300
Duration                 : 2 min 3 s
Bit rate mode              : Constant
Bit rate                 : 1 152 kb/s
Channel(s)                : 1 channel
Sampling rate              : 48.0 kHz
Frame rate                : 25.000 FPS (1920 SPF)
Bit depth                : 24 bits
Stream size               : 16.9 MiB (2%)
Locked                  : Yes
Audio #8
ID                    : 2560
Format                  : PCM
Format settings             : Little
Format settings, wrapping mode      : Frame (AES)
Codec ID                 : 0D01030102060300
Duration                 : 2 min 3 s
Bit rate mode              : Constant
Bit rate                 : 1 152 kb/s
Channel(s)                : 1 channel
Sampling rate              : 48.0 kHz
Frame rate                : 25.000 FPS (1920 SPF)
Bit depth                : 24 bits
Stream size               : 16.9 MiB (2%)
Locked                  : Yes
Other #1
ID                    : 0-Material
Type                   : Time code
Format                  : MXF TC
Frame rate                : 25.000 FPS
Time code of first frame         : 00:00:00:00
Time code settings            : Material Package
Time code, striped            : Yes
Title                  : Timecode
Other #2
ID                    : 0-Source
Type                   : Time code
Format                  : MXF TC
Frame rate                : 25.000 FPS
Time code of first frame         : 00:00:00:00
Time code settings            : Source Package
Time code, striped            : Yes
Other #3
Type                   : Time code
Format                  : SMPTE TC
Muxing mode               : SDTI
Frame rate                : 25.000 FPS
Time code of first frame         : 00:00:00:00

[JaenalLeeGenMao]

it is somewhat related to #2866
I can play it fine in 3.0.x but fails on 2.5.x

[TheModMaker]

So it works in v3.x, right? What is the reason for not upgrading to v3? I'm getting a 403 error from the manifest URL. Could you provide a accessible URL? You can send them privately to shaka-player-issues@google.com if you can't post publicly.

3016 is a decoder error from the browser. This usually means the browser can't play the media. Usually there is nothing we can do, but the fact that it works in v3 means there may be a fix. But it can be hard to locate and would be much better for you to just update to v3.

Also the media info you posted doesn't make much sense. If appears to use a MXF container, which probably isn't supported by the browser and there appear to be multiple audio streams. Wrapping multiple audio streams within a single file isn't supported. We officially support audio and video in different streams and mostly support multiplexed (audio+video) streams, but that is dependent on browser support.

[JaenalLeeGenMao]

@TheModMaker I have sent the .mpd files to the link and apparently what hinders us from upgrading from 2.5.x to 3.0.x is breaking changes. On 2.5.x I keep getting audio_decode_error and video plays without sounds. Version 3.0.x and I notice there are several changes on audio codec and such, I was hoping if shaka team could help(perhaps cherry-pick).

[joeyparrish]

@JaenalLeeGenMao, do you still have this issue with the latest releases, v3.0.6 and v2.5.18?

Decode errors such as PIPELINE_ERROR_DECODE are likely to be out of our direct control, as decoding happens inside the browser.

[shaka-bot]

Closing due to inactivity. If this is still an issue for you or if you have further questions, you can ask us to reopen or have the bot reopen it by including @shaka-bot reopen in a comment.