Skip to content

v3.0

Choose a tag to compare

@ekassos ekassos released this 10 Apr 02:29
· 960 commits to main since this release
eed0a09

Release Notes

Voice Mode

New Features

  • Assistants can now be configured to use Voice mode, in addition to the existing Chat mode. (#810)
  • In Voice mode, users can interact with an assistant with their voice through the Realtime API, offering fluid and natural conversations. (#810)
  • After a session ends, users can review a transcript of their conversation. (#810)
  • Voice mode conversations are specially marked in the Recent Threads section of the Sidebar. (#810)
  • When setting up an assistant, users can provide an instructional prompt to the assistant, and set the temperature. A temperature value of 0.8 is highly recommended for audio assistants, with acceptable values between 0.6 and 1.2. (#810)

Known Issues

  • Voice mode is currently unavailable for groups using Azure as their AI provider.
  • Conversations in Voice mode can only happen in a single session. Once a session has concluded, the thread becomes read-only.
  • In some threads, when viewing the conversation transcript, some messages may appear out of order. (#817)
  • When an Assistant is configured to use Voice mode after being configured to use Chat mode, existing Chat mode threads become read-only.
  • Voice mode conversation threads are not titled with a summary title. Instead, they appear as Audio Conversation in the Sidebar.
  • Voice mode is currently unavailable on Firefox and related forked browsers. (#811)
    Workaround: Use Voice mode in Chrome, Edge, or Safari.

Deployment Information

Schema Upgrade Migration Script Permissions Update Task Definition Update Configuration Update
YES No No No No

Deployment Details

  • Schema Upgrade: New interaction_mode fields in Assistant and Thread tables.

Related PRs

Full Changelog: 644-srv266-web152...645-srv267-web153