Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Detect relatively small/far-away faces for swap #22

Open
epicstar7 opened this issue Jun 12, 2022 · 2 comments
Open

Detect relatively small/far-away faces for swap #22

epicstar7 opened this issue Jun 12, 2022 · 2 comments
Labels
question Further information is requested

Comments

@epicstar7
Copy link

I noticed that the face is not always detected in target images and this happens when the face is relatively small in the target image. I have been digging into it a bit, but as far as I understand this has something to do with the implementation of the Google Mediapipe Face Mesh into Simswap. Face Mesh is not able to detect such small faces. But when using Simswap from the original repo this is not an issue and the swap always works fine. I also read that the Mediapipe has no solution yet for smaller faces in combination with the Face Mesh, tho they have it for Face Detection.

Is there a way to bypass the Face Mesh Pipeline and to make the swap happen using original Simswap? Or is there maybe another way to make swapping of relatively small faces possible or to implement something for this?

@epicstar7 epicstar7 added the question Further information is requested label Jun 12, 2022
@giorgiop
Copy link
Member

Thanks for the feedback. This is indeed a know limitation of mediapipe. We may extend dot for the use of a different face detector in the future, but it isn't on the roadmap soon.

Would you be interested to work on a PR for this feature?

@epicstar7
Copy link
Author

I'm not a programmer and don't have any technical knowledge to be of any value in this context, I'm sorry. Would be great if this could be implemented by someone who could make it tho, so I would put it on a backlog or something.

@ajndkr ajndkr self-assigned this Jul 4, 2022
@ajndkr ajndkr removed their assignment Feb 7, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

3 participants