Repository navigation
Voice, video and robots, agents that share what they find, and documents filled from many model calls.
pip install -U agent-adapter
pip install -U "agent-adapter[voice-cloud]" # hosted speech-to-text and text-to-speechHighlights
- VoxCat, our own voice pipeline (
agent_adapter.voice). Phone calls (Twilio, Telnyx, Plivo, Vonage), browser calls over WebRTC, and the local mic. Spoken approvals before side effects, and nothing is done twice when the caller interrupts. It is fast with any speech-to-text and text-to-speech, open models included: its own end of turn (EagerTurns), replies started on interim words, and the first words spoken early. Set up a whole call from one file and run it withagent-adapter voice serve voxcat.yaml. - Benchmark against LiveKit Agents and Pipecat (
scripts/voxcat_vs.py), on the same fake parts in real time. VoxCat starts speaking about 0.4 s sooner, and stops within one frame when the caller cuts in. Method and limits: https://agent-adapter.veloceai.in/how-to/voxcat-benchmark/ - Video and robots: camera and screen feeds for tools (
VideoFeed,look_tool), and robot safety in simulation (MuJoCo, ROS 2). - Shared board (
agent_adapter.board): parallel or sequential agents see what the others are doing and have found. - In-flight sharing: when agents make the same cached tool or model call at the same moment, one real call runs and the others share its result.
- Template documents (
agent_adapter.compose): fill a Markdown, HTML, XML or text template from many model calls, with citations.
Docs: https://agent-adapter.veloceai.in/voice/
Full changelog: https://github.com/VeloceAI/agent-adapter/blob/main/CHANGELOG.md