Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

enh: better voice interactions #2241

Closed
2 tasks done
tjbck opened this issue May 13, 2024 · 2 comments
Closed
2 tasks done

enh: better voice interactions #2241

tjbck opened this issue May 13, 2024 · 2 comments
Assignees
Labels
core core feature enhancement New feature or request
Milestone

Comments

@tjbck
Copy link
Contributor

tjbck commented May 13, 2024

  • voice message recording like imessage
  • siri-esque real time voice interaction
@tjbck tjbck self-assigned this May 19, 2024
@tjbck tjbck changed the title enhancement: better voice interactions enh: better voice interactions May 19, 2024
@tjbck tjbck added this to the v1.0 milestone May 19, 2024
@tjbck tjbck added enhancement New feature or request core core feature labels May 19, 2024
@tjbck tjbck modified the milestones: v1.0, v0.2.0 May 26, 2024
@IIPedro
Copy link

IIPedro commented May 31, 2024

Hello! I'm unaware if work has been done about this topic yet, but it would be interesting to see better voice interactions as part of pipelines. Of course, it should be the front-end's job to provide an easy to use and comfortable interface, but I believe both siri-esque interaction and voice calls can be tackled in one go with a new pipeline function. Just like there's a pipe def in pipelines, it would be very useful to have a voice def that takes an audio buffer as input in a previously determined rate and returns another audio buffer, which would be the assistant's voice in the call. That would make voice interactions as versatile as current chat pipelines and would allow for the support of various libraries and APIs in a standardized manner. Thanks!

@tjbck tjbck modified the milestones: v0.2.0, v0.3.0 May 31, 2024
@tjbck
Copy link
Contributor Author

tjbck commented Jun 8, 2024

Implemented on dev.

@IIPedro Great suggestions, I'll see what can be done!

@tjbck tjbck closed this as completed Jun 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
core core feature enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants