Audio support

[JonnyBurger]

Right now, the Audio does not get rendered in the output.

Ideally you can add as many elements whereever you want, and Remotion will do the composition! Most likely this will use FFMPEG flags to do the composition, but I am not yet 100% sure.

You can subscribe to this issue to follow the progress.

[nandorojo]

@JonnyBurger I'm interested in using a youtube video's iFrame in my video. Will it be possible to take the audio from another video and use it here?

[JonnyBurger]

@nandorojo I think we can do a youtube video and sync it with the Remotion frame, but the audio seems to be inaccessible because we need to feed it into the ffmpeg command, so for that we need to download it.

Also if we include the YouTube player, we will always have a YouTube watermark which is not so nice.
The best way to achieve this and still stay completely programmatic is to use the ytdl CLI application to first download the video, and then use it locally. This will definitely work!

[nandorojo]

Got it, downloading it makes much more sense.

[xavijam]

It is likely a crazy and non-sense idea, but would it support something like this?

[JonnyBurger]

@xavijam Not quite, I researched it and there is no way to render an audio generated by SpeechSynthesis to an audio tag or to save it. It's a feature that browsers are lacking at the moment.

However, using something like Google Cloud Speech to Text, I'm confident it works!

[xavijam]

That's fantastic, thank you!

[JonnyBurger]

Released in 2.0!

https://remotion.dev/blog/2-0

[deeayeen]

@JonnyBurger is SpeechSynthesis still unusable in Remotion?

[JonnyBurger]

@deeayeen It still is.