Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Enhancement]: flipped faces - upside down #463

Open
3 tasks done
kalle07 opened this issue Jun 10, 2024 · 4 comments
Open
3 tasks done

[Enhancement]: flipped faces - upside down #463

kalle07 opened this issue Jun 10, 2024 · 4 comments
Labels
bug Something isn't working 🔬 research

Comments

@kalle07
Copy link

kalle07 commented Jun 10, 2024

First, confirm

  • I have read the instruction carefully
  • I have searched the existing issues
  • I have updated the extension to the latest version

What happened?

dont work in upside-down positions
faces much to big and distorted

all works fine wiht faces more or less in right position

Steps to reproduce the problem

Sysinfo

win10
latest version a1111 and latest reactor

Relevant console log

no error

Additional information

No response

@kalle07 kalle07 added bug Something isn't working new labels Jun 10, 2024
@Gourieff
Copy link
Owner

Yes, this the issue
The best result - when faces are in the "proper" position (have no tilt > 90)

@drdancm
Copy link

drdancm commented Jul 1, 2024

The only solution (unless it is a CloseUP) is to flip your image so it is in or close to Front Portrait position. Swapping works well even at about 90 degrees from the ideal position. For upside down, just rotate the image. Photos of Faces rotated in close to or away from camera in Z dimension, become problematic as the angle grows and there is no solution.

@kalle07
Copy link
Author

kalle07 commented Jul 1, 2024

but what is the problem ...
inswapper_128.onnx ?
or is it the implementation to search for pattern in all rotations ?

@drdancm
Copy link

drdancm commented Jul 1, 2024

I think you've hit the nail on the head: inswapper and the like.
Perhaps you have noticed that we humans also have some problems with upside down faces. It takes us longer to recognize the face. It is even more of a problem with negatives (light and dark is reversed). In fact we are terrible with negatives.
This does not mean that Ai should have a problem, in our applications, because it can be solved, as you already suggested by preprocessing rotations (flipping in case of upside down faces, and so on.) Evolution has not had to make us work with negative images, but Ai could fix that easily by just reversing the shading.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working 🔬 research
Projects
None yet
Development

No branches or pull requests

3 participants