Please support for audio/wav (PCM) in MSE

[petamoriken]

I converted original format files to PCM files in Web Worker (by Emscripten), and I tried to stream by MSE.
However, this trial doesn't achieve, because MSE hasn't support for audio/wav in almost browsers yet.

I hope that it's mentioned in Media Source Extensions Byte Stream Format Registry. Thanks!

[jdsmith3000]

Triaging per the new MSE & EME Spec Issue Triage Process.

This issue requests support for a new format, and doesn't meet the triage criteria for V1 or V1NonBlocking.

[wolenetz]

FWIW, I agree this looks appropriately triaged to VNext.

[tjenkinson]

Any update on this? I would like to decode audio to PCM with web assemblly and then play in MSE

[EE-GSlomin]

This seems to work with MOV files.

[PetrochukM]

Hi!

Fundamentally, it should be easy to stream raw samples and play them sequentially via HTMLMediaElement. (Similar to the old Mozilla Audio API) Without this issue being resolved, how is this possible?

There are a number of problems that'd be solved with this addition:

• http://papers.traustikristjansson.info/?p=486
• http://blog.mecheye.net/2017/09/i-dont-know-who-the-web-audio-api-is-designed-for/
• https://github.com/samirkumardas/pcm-player
• https://stackoverflow.com/questions/43366627/cracks-in-webaudio-playback-during-streaming-of-raw-audio-data/43403670#43403670
• https://stackoverflow.com/questions/38646544/appending-pcm-data-to-a-mediasource?rq=1
• https://stackoverflow.com/questions/10040317/getting-raw-pcm-data-from-webaudio-mozaudio
• https://github.com/brion/audio-feeder/tree/refactor
• https://github.com/samirkumardas/pcm-player
• https://stackoverflow.com/questions/14143652/web-audio-api-append-concatenate-different-audiobuffers-and-play-them-as-one-son/14148125

[guest271314]

It is possible to use Web Audio API AudioWorklet to stream audio/wav (PCM). FWIW see WebAudio/web-audio-api-v2#61, https://guest271314.github.io/AudioWorkletStream/, https://plnkr.co/edit/nECtUZ.

[petamoriken]

...or will it be supported by WebCodecs?
https://github.com/WICG/web-codecs

[guest271314]

@petamoriken WebCodecs is not specified or implemented. Created the linked code a a proof-of-concept of how WebCodecs potentially could be connected to Web Audio API WebAudio/web-audio-api-v2#61. The gist of the WAV parsing algorithm is based on https://stackoverflow.com/a/35248852. Extended to be used with AudioWorkletProcessor https://github.com/guest271314/AudioWorkletStream/blob/master/audioWorklet.js. Similar to MediaSource, the current version requests multiple parts of the same file (actually due to GitHub not allowing upload of files over 25MB split the 71MB file into four parts).

[guest271314]

Essentially, users in the field that want support for x-codec can roll their own instead of or while waiting for API's to specify and implement algorithms. That is why included the module "codecs" https://github.com/guest271314/AudioWorkletStream/blob/master/codecs.js where any user codec parsing code can be placed. There is no bar from users implementing their own processor, and no guarantee that parsing algorithms implemented by others will achieve what the developer cannot themselves while waiting for an external working group to agree with the concept or request, specify and implement.

[ewof]

please 🙏
coqui tts is all wav format :(((