Live audio transcription / translation

[ahcm]

Hi,

using something like whisper.cpp, https://github.com/ggerganov/whisper.cpp, could enable live audio transcription and translation.

Is someone already working on something like this?

Thanks!
Andreas

[hiroshisuga]

This (#16442) seems planned (or discussed) for BBB2.7.
Whisper looks wonderful nevertheless!

[ffdixon]

Yes. You'll see #16442 merge into 2.7 development and form the basis for work on incorporating Whisper as well.

[JulianKropp]

Hey. I want to let you know I started a new project a year ago. Instead of adding a new feature to BBB, I started to develop a bot that joins the audio channel listens to the conversation, and starts converting audio into text. It can also translate many languages into English. Everything works completely self hosted and without any cloud like Google or Microsoft. I'm using the open-source AI whisper from Open AI.

Have a look and try it out. Its an early prototype but I would love to get some feedback and some support to continue developing my Big Blue Button translation bot.

bbb-translation-bot

bbb-bot