Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support the new Face blendshapes graph #12

Closed
GeorgeS2019 opened this issue Feb 23, 2023 · 6 comments
Closed

Support the new Face blendshapes graph #12

GeorgeS2019 opened this issue Feb 23, 2023 · 6 comments

Comments

@GeorgeS2019
Copy link

This is 2 weeks newer than 0.91 1st Feb 2023 releaes

Add mediapipe tasks face blendshapes graph

@j20001970
Copy link
Owner

Hi, what would your usage of face blendshapes graph look like? If I understand it correctly the graph would be applied on top of existing face mesh graph by connecting predicted landmarks to it as input. If that is the case we will need additional functionality that will add new calculator nodes to initialized graph config on the plugin side.

@GeorgeS2019
Copy link
Author

GeorgeS2019 commented Feb 25, 2023

@j20001970
This is the use case: ARKit 52 blendshapes

This is missing in Godot, the ability to take the webcam and perform face motion capture and drive an avatar e.g. created using industry standards based on 52 blendshapes

This will allow Godot users to be the game engine that supports users e.g. using Android or Web to drive avatars.

Currently, only iPhone with a depth camera can drive the industry standards avatar with 52 blendshapes

FYI: another use case

@GeorgeS2019
Copy link
Author

@j20001970

Thx for updating the mediapipe :-)

@j20001970
Copy link
Owner

@j20001970

Thx for updating the mediapipe :-)

No problem :)

@GeorgeS2019
Copy link
Author

GeorgeS2019 commented Mar 9, 2023

@GeorgeS2019
Copy link
Author

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants