Blendshape scores and facial_transformation_matrixes in holistic model

[ChristianNSchmitz]

MediaPipe Solution (you are using)

Python version 0.10.11

Programming language

Python

Are you willing to contribute it

None

Describe the feature and the current behaviour/state

I would like to ask you whether the updated holistic model includes blend shape scores and the facial_transformation_matrixes. If not, I would like to ask if you could include these metrics. Thanks a lot! Christian

Will this change the current API? How?

No response

Who will benefit with this feature?

No response

Please specify the use cases for this feature

Research

Any Other info

No response

[kuaashish]

Hi @ChristianNSchmitz,

If you refer to the HolisticLandmarkerResult API documentation, you will notice that Blendshape is listed as optional, and currently, Facial Transformation matrices are not included. However, we are actively working on updating the documentation, which will be released soon. Unfortunately, we are unable to provide an exact date at this time.

Thank you!!

[ChristianNSchmitz]

Dear @kuaashish, thank you very much for your response! For our use case, we would like to project the face back to a normalised space in order to make it comparable. Would you have a suggestion how to do that without the transformation matrix or to extract the transformation matrix somewhat differently?