v3.0
·
960 commits
to main
since this release
Release Notes
Voice Mode
New Features
- Assistants can now be configured to use Voice mode, in addition to the existing Chat mode. (#810)
- In Voice mode, users can interact with an assistant with their voice through the Realtime API, offering fluid and natural conversations. (#810)
- After a session ends, users can review a transcript of their conversation. (#810)
- Voice mode conversations are specially marked in the Recent Threads section of the Sidebar. (#810)
- When setting up an assistant, users can provide an instructional prompt to the assistant, and set the temperature. A temperature value of 0.8 is highly recommended for audio assistants, with acceptable values between 0.6 and 1.2. (#810)
Known Issues
- Voice mode is currently unavailable for groups using Azure as their AI provider.
- Conversations in Voice mode can only happen in a single session. Once a session has concluded, the thread becomes read-only.
- In some threads, when viewing the conversation transcript, some messages may appear out of order. (#817)
- When an Assistant is configured to use Voice mode after being configured to use Chat mode, existing Chat mode threads become read-only.
- Voice mode conversation threads are not titled with a summary title. Instead, they appear as Audio Conversation in the Sidebar.
- Voice mode is currently unavailable on Firefox and related forked browsers. (#811)
Workaround: Use Voice mode in Chrome, Edge, or Safari.
Deployment Information
| Schema Upgrade | Migration Script | Permissions Update | Task Definition Update | Configuration Update |
|---|---|---|---|---|
| YES | No | No | No | No |
Deployment Details
- Schema Upgrade: New interaction_mode fields in Assistant and Thread tables.
Related PRs
Full Changelog: 644-srv266-web152...645-srv267-web153