AI Voice tutorial - Application creation

[moritzfelipe]

This should be a tutorial.
We want to create a tutorial that explains how to create an application that can converse via voice and natural language with the user.

First step: Create the application

The app should behave like the following:

• The user can tap on a button and start to talk to the APP.
• The App will respond in natural language.
• The App will have a history of the conversation.

Tech specs (up for discussion)

• We can use the boilerplate that we have, maybe improve it
• Next.js
• Javascript
• OpenAI API
• Whisper for voice recognition
• 11 labs for TTS (? Free)
• Responses should be streamed so it does take much time
• Maybe small backend for streaming

Inspiration is ChatGPT voice conversations, which are really powerful because they make it easier for the user to interact with it, remove friction, and create more engagement.

This could be potentially interesting for springer, XU, dacade, or our own MVP products.