Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is there a plan to support faceid #2

Open
libai-lab opened this issue Aug 7, 2024 · 7 comments
Open

Is there a plan to support faceid #2

libai-lab opened this issue Aug 7, 2024 · 7 comments

Comments

@libai-lab
Copy link

Is there a plan to support faceid

@stazizov
Copy link
Collaborator

stazizov commented Aug 7, 2024

Is there a plan to support faceid

IP-adapter in progress, faceid next

@cubiq
Copy link

cubiq commented Aug 7, 2024

can we try to use embeds from something a little less strict than insightface?

@JorgeR81
Copy link

JorgeR81 commented Aug 7, 2024

FaceID would be really great.
Flux is good quality, but the faces are very similar.

reddit also noticed ...
https://www.reddit.com/r/FluxAI/comments/1ek5h9g/faces_are_kinda_samey/

Prompting for different ethnicities, gives some improvement, but we still have the same overall facial traits.
https://www.reddit.com/r/FluxAI/comments/1emd5s2/flux_female_ethnicities_comparison_193/
https://www.reddit.com/r/FluxAI/comments/1eldafl/test_prompt_complexity_with_fluxdev/

@stazizov
Copy link
Collaborator

stazizov commented Aug 7, 2024

can we try to use embeds from something a little less strict than insightface?

Any suggestions? We are glad to cooperate

@cubiq
Copy link

cubiq commented Aug 7, 2024

ideally you'd train an actually open source insightface model, you actually need just feature extraction and recognition not the whole shebangs. Otherwise one might look at different models altogether but they might have a different shape so more work would be needed for training. We can discuss further if you want (matt3o on discord, cubiq on X).

@JorgeR81
Copy link

JorgeR81 commented Aug 7, 2024

An open source insightface model could also be a good combination, with Flux [schnell] ( apache-2.0 licence )
I'm not loving the Flux [schnell] portraits so far, but they could improve in quality, with FaceID
From my personal experience with SDXL, FaceID seems to make the skin texture and facial traits more realistic ( independently of face similarity ).  Even when face similarity is not great, the image itself seems to be better quality, just by using FaceID.
And I have just as good results, if not better, with SDXL lightning + FaceID ( at just 6 steps ), than regular SDXL + FaceID ( at 20 steps ). 

@stazizov
Copy link
Collaborator

On the way
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants