Talk to the computer, and it tells you, or does, something useful.
Currently, AI Agents & Chat Bots are slow and expensive. They make silly mistakes. They're forgetful. And they work too hard reinventing the wheel.
Even the simplest of vox in & vox out UX -- especially when coupled with agentic behaviors -- is hard. It's asynchronous, and usually frustratingly slow. It's a new way of interacting with computers, which requires a global re-thinking of how different the UI control and display modalities interact.
I'm working on helping Agents remember what problems they've already solved, or if they've solved something semantically synonymous or computationally analogous before.
Fast, real time responses, asynchronous callbacks for big jobs, and more natural, human-like interaction. You will want to talk to your computer!
There are two ways to answer a question when using agentic vox 2 vox: The fast, or agonizingly slow, way.
I'm currently working on
- Agentic learning (code refactoring) based on previously solved problems stored in long-term memory
- Using query-to-function mapping similar to what ChatGPT is doing, and
- Providing human in the loop feedback when agents go awry
- I can perform basic browsing tasks with Firefox using my voice
- I can edit, spellcheck and proofread documents using my voice
- I can also interact with PyCharm using my voice
- Interact seamlessly, asynchronously and in real time, with calendaring and TODO list apps using my voice
- Do the same with a web research assistant to replace what I'm doing manually with ChatGPT
- Have my agents speak to me with any of my favorite character voices in multiple languages
- Host my own internal LLM server for privacy and security
- Interact with my agents, servers & computers using my voice, and have it do what I want it to do, when & how I want it done. I'm not asking for much, am I?
- Safely and securely, of course
- World peace, non X, and all that too
This Genie-in-the-box project is currently an extremely large set of working sketches which I am actively organizing & tidying up so that I can collaborate with others.
So, I'm not there yet, obviously. But I'm working on it and getting closer every day.
Interested?
Begin!