Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Can we use this to generate pose from text? #23

Open
gutzcha opened this issue Dec 14, 2023 · 2 comments
Open

Can we use this to generate pose from text? #23

gutzcha opened this issue Dec 14, 2023 · 2 comments

Comments

@gutzcha
Copy link

gutzcha commented Dec 14, 2023

Hello and thank you for you work, this looks really good.
I was able to download and install the repo but I was unsure on how to use it,
Can we create gestures from text using this model? if so, then how?

@UttaranB127
Copy link
Owner

The model uses speech audio and text transcripts of the speech to generate motions. Do you mean generation from text prompts? For that, the text encoder module needs to be repurposed to work with the prompts rather than transcripts.

@gutzcha
Copy link
Author

gutzcha commented Dec 15, 2023

Interesting, thank you for taking the tine to answer.
I will try it using a text to speach generator.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants