SaraKIT is equipped with three microphones and a specialized sound processor that cleanses the voice and supports speech recognition on Raspberry Pi from distances up to 16.4 feet (5 meters). Building a voice-operated ChatGPT is possible through various methods, with many examples available on GitHub. Here, I propose a solution based on the offline speech recognition tool Vosk, used for wake word detection and command recognition, and Piper for speech generation - both programs are currently the best offline Text to Speech (TTS) and Speech to Text (STT) solutions for Raspberry Pi. The offline approach means continuous internet connectivity is not required, ensuring privacy and a free solution.
For more details on Piper, see here: https://github.com/SaraEye/SaraKIT-Text-To-Speech-Piper-Raspberry-Pi
For more on Vosk, check out: https://github.com/SaraEye/SaraKIT-Speech-Recognition-Vosk-Raspberry-Pi
Assuming the basic SaraKIT drivers are already installed (Getting Started with SaraKIT), follow these steps to install the required tools:
sudo apt-get update
sudo apt-get install -y python3-pip python3-pyaudio libasound2-dev libfmt-dev libspdlog-dev
sudo pip3 install vosk piper-tts openai
git clone https://github.com/SaraEye/SaraKIT-Voice-ChatGPT-Raspberry-Pi VoiceChatGPT
cd VoiceChatGPTBefore running, you'll need to insert your OpenAI API key, which you can obtain by registering on OpenAI's website.
Insert your API key in the line:
client = OpenAI(api_key="YOUR_API_KEY_HERE")Set your wake word in the line:
WakeWord="sarah"If you wish to change the language from English or adjust the voice for Piper or Vosk, download and load the appropriate models. See the descriptions on Piper's GitHub and Vosk's GitHub for guidance.
To run:
python VoiceChatGPT.pyInitially, the chat waits for the wake word, by default "sarah". After recognizing it, you can ask ChatGPT anything, and it will respond verbally.
This setup creates a powerful, private, and interactive voice assistant using the capabilities of ChatGPT, SaraKIT and Raspberry Pi. Dive into creating your personalized voice-operated assistant today!
On our website, you can discover an even more advanced version we've dubbed SaraEye, where ChatGPT activation doesn't rely on a wake word but on gaze recognition, mimicking human interaction. When we look at someone, they know we're addressing them. Similarly, here, you simply look at ChatGPT to engage, eliminating the need for constant wake prompts like "Alexa, Alexa, Alexa..." :)
SaraEye: https://youtu.be/aLGZZ5pAoj0
Pan/Tilt Camera (or Turret Base): https://sarakit.saraai.com/example-of-use/camera-pan-tilt
SaraKIT Project Page: https://sarakit.saraai.com
The effects of this simple yet powerful script can be seen in the video below: