Get landmark points for Face mesh[ARCore and ARKit]

[weacw]

I want to get the landmark points of the face mesh and paste the 2D stickers to the corresponding places (for example: glasses try on, eyebrows, nose etc)

Or
Is there a better solution?

[tdmowrer]

ARKit provides blend shapes and ARCore provides face regions.

However, those don't tell you exactly where the eyebrows and nose are, for example. Other people have used hard-coded indices for those. However, this approach will only work specific devices because the face mesh can vary across different devices. Others have used OpenCV to extract facial landmarks.

[weacw]

thank you for your reply.

[weacw]

Oh sorry. How to know whether the user is opening or closing the mouth (eye etc)

I have tried to put a texture on the face mesh but there is a problem with the UV mapping

[tdmowrer]

On ARKit, you can use blend shapes for that. There is a sample in this repo that shows how to use them: https://github.com/Unity-Technologies/arfoundation-samples#arkitfaceblendshapes

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.