Terminal Voice Assistant

Terminal Voice Assistant is a powerful and flexible tool designed to help users interact with their terminal using natural language commands.

This sounds simiar to the popular openinterpreter and 01 Light project in development, aiming for a full computer experience. While it uses a terminal state for interaction, it isn't exactly what I am looking for in terms of side-by-side AI assistance, 01's ultimate goal is of providing a hands-free human computer interface.

Terminal Voice Assistant offers a unified terminal interface where users can SSH, perform operations, install, edit, and remove files. Unlike traditional request-response models, this assistant provides continuous access to the terminal state, allowing users to interact and monitor processes in real-time.

Features

• Handles complex path descriptions using "slash" (e.g., "slash home slash download" becomes "/home/download").
• Integrates with OpenAI's language models to ensure accurate and efficient command generation.
• Uses picovoice for quick and efficient wake word detection.
• Access to the terminal state, even in the midst of errors or SSH sessions, rather than following a strict request-response model
• Most of the other available tools convert NLP to Bash, for example: List me the files in the current folder However, they don't work with: ls -al (spoken as "l s minus a l" for text-to-speech) This project involves converting realistic vocal commands into actual code, sometimes for developers its easier to say the command than to describe it in english haha

Current workflow

Enlarge image

Installation

1. Download Wezterm, open it and create a horizontal split.
2. In a new terminal git clone https://github.com/0xrushi/Terminal-Voice-Assistant.git && cd Terminal-Voice-Assistant
3. Rename .env.example to .env and update the OpenAI and Picovoice api keys
4. Install the python packages

conda create -n tvassist python=3.10
conda activate tvassist
conda install pyqt5
pip install -r requirements.txt

5. make run
6. make kill # to exit

Demo

Contributing

We welcome contributions from the community. If you have suggestions for improvements or want to report bugs, please open an issue or submit a pull request.

License

This project is licensed under the MIT License. See the LICENSE file for more details.