Talon-AI-Tools

Control large language models and AI tools through voice commands using the Talon Voice dictation engine.

This functionality is especially helpful for users who:

Prompts and extends the following tools:

Github Copilot
OpenAI API (with any GPT model) or simonw/llm CLI for text generation and processing
- Any OpenAI compatible model endpoint can be used (Azure, local llamafiles, etc)
OpenAI API for image recognition

Setup:

Download or git clone this repo into your Talon user directory.
Choose one of the following three options to configure LLM access (unless you want to exclusively use this with Copilot):

Caution

Make sure you do not push the key to a public repo!

# Example of setting the environment variable
import os

os.environ["OPENAI_API_KEY"] = "YOUR-KEY-HERE"

Note

Run llm keys set with the name of the provider you wish to use to set the API key for your requests. i.e. llm keys set openai.

user.model_endpoint = "llm"
# If the llm binary is not found on Talon's PATH, uncomment and set:
# user.model_llm_path = "/path/to/llm"

user.model_default = "claude-3.7-sonnet"  # or whichever model you installed

By default, all model interactions will be logged locally and viewable on your machine via llm logs. If you prefer, you can disable this with llm logs off.

user.model_endpoint = "https://your-custom-endpoint.com/v1/chat/completions"

This works with any API that follows the OpenAI schema, including:

See the GPT or Copilot folders for usage examples.