New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Detect eyes, nose and mouth precisely. #1

Closed
jointdev opened this Issue Mar 13, 2018 · 5 comments

Comments

Projects
None yet
3 participants
@jointdev

jointdev commented Mar 13, 2018

Congratulations for this incredible library!

Can I get precise coordinates of eyes, mouth and nose?

Let me explain what I want to do ... I'm not a blander/threeJs professional and I want to use CSS3 capabilities to position objects on camera using coordinates delivery from jellizFaceFilter library. This is possible?

@xavierjs

This comment has been minimized.

Member

xavierjs commented Mar 14, 2018

Hello,

Thank you for your interest about JeelizFaceFilter API :)
Unfortunately the detection of the face is a global detection. We do not detect specific keypoints like BRFv4 for example (https://github.com/Tastenkunst/brfv4_javascript_examples).

We are going to release an upgrade where the mouth opening coefficient is detected.

But the current head detection frame is centered on the middle of the eyes so you can retrieve the position of the eyes quite accurately. Idem for the nose. But for the mouth I think there will be more variability because there are people with a lot of space between the mouth and the nose, and other whose mouth is almost stitched to the nose.

I will put the dev of a demonstration using canvas2D or CSS3 on my pipeline and keep you informed.

@jointdev

This comment has been minimized.

jointdev commented Mar 14, 2018

Great! I already tested the brfv4 library before but I prefer your solution, including I can't use the brfv4 in a commercial app and the licence is expensive (in brazilian currency).

I'm following the "luffys hat" tutorial that is a perfect start point for my project.

I will share my project in github when I finish him.

Thank you very much.

@jointdev jointdev closed this Mar 14, 2018

@xavierjs xavierjs reopened this Apr 23, 2018

@xavierjs

This comment has been minimized.

Member

xavierjs commented Apr 23, 2018

Hi,
We have added the CSS3D support for easier integration.
The link to the boilerplate and another CSS3D example are included from the README.
I tested it on Ipad, on android and desktop.

@nitish24p

This comment has been minimized.

nitish24p commented Sep 6, 2018

Is it possible to only color certain parts of the face, like the eyes or the lips and then the colored portion moves as the person smiles etc

@xavierjs

This comment has been minimized.

Member

xavierjs commented Sep 6, 2018

this is not possible bc the detection is global

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment