adds Whisper support (adds Sppeech to text) - #10612
Conversation
Bod9001
changed the title
| { | ||
| if (UIManager.IsInputFocus) return; | ||
| Showing = false; | ||
| STTImageText.color = Color.white; |
There was a problem hiding this comment.
All of this seems like it should be managed by its own component, and not be a part of the chat UI, since it is not its responsibility.
There was a problem hiding this comment.
well the chat you're has its own button to toggle the SST since you can't press m
There was a problem hiding this comment.
and you can't have a component that references the button because?
There was a problem hiding this comment.
Isn't thhis what I'm saying with each UI element should have its own script attached?
There was a problem hiding this comment.
Was quicker to do through the chatUI
There was a problem hiding this comment.
also resetting when the caht UI closes
There was a problem hiding this comment.
this button is for the chat you only it only shows when you open the cchat
3 participants
Notes:
model distribution needs to be worked out still, since it needs to be cashed somewhere, worst-case Scenario we bundle it as part of the game
https://huggingface.co/ggerganov/whisper.cpp/blob/main/ggml-tiny.bin
official link
currently looks in UnityProject\Assets\StreamingAssets\Whisper
Changelog:
CL: [New] Adds locally run Speech to text system (Whisper)
CL: [New] by pressing M (and waiting for the hub dialogue) you can now use speech to text in game
CL: [New] using speech to text while chat is not selected it will automatically post in chat when you finish by pressing M
CL: [New] using speech to text while chat is selected it will automatically populate the text field when finished