This project a submission for the Mercor backend vetting project assignment.
Please open this url to access the frontend - https://main.dbg07i5yve34w.amplifyapp.com/
Steps to validate -
-
once the frontend is open, click on the unmute button at the bottom left of the page.
-
If the button is saying "mute", then the microphone is active, and the speech recognition has begun. The window to the right hand side will show the live transcript of what the speech recognition has captured from your speech.
-
After speaking the query into the mic, the app will wait for 1.5 seconds, once the time is up, it will send a post request to the backend.
-
Once the request is sent, the backend endpoint will run the function to start the Chat GPT response.
-
Once the response is ready, the react app should automatically play the audio of the generated Chat GPT response.
-
The response can also be seen below the live transcript text.
-
incase the generated response is too long, you can press the stop gpt response, and the audio will stop playing, at which point you can continue asking more queries.
NOTE - while the mic is unmuted, the app will continue speech recognition indefinitely, in order to close it, please mute the microphone.