Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Heatmaps #5

Closed
affromero opened this issue Apr 27, 2020 · 3 comments
Closed

Heatmaps #5

affromero opened this issue Apr 27, 2020 · 3 comments

Comments

@affromero
Copy link

Hello, nice work.
I have a couple of doubts regarding the heatmaps.

  1. Could you please elaborate on these values? Why resizing and shifting heatmaps and why those numbers for different regions of the face (x and x2)? In the main paper, there is nothing about heatmaps or keypoints, so I am trying to understand the intuition.

  2. Are wing.ckpt pre-trained weights the same as in this work, or do they differ in some way?

  3. Does CelebA_HQ work without heatmaps?

Thanks :)

@youngjung
Copy link
Collaborator

Hi, thanks for your interest.

  1. Those heatmaps indicate the regions where we want to keep the source image stronger.
    x is for a coarse layer and x2 is for finer layer. (similar definition of coarse and fine in StyleGAN)

  2. Yes, the same.

  3. Yes it still works. Just eyes, nose and mouth of the source image will be less-reflected.

Do these answer your question?

@affromero
Copy link
Author

Yes, pretty much.
The last remaining thing is about the resizing and shifting of the heatmaps.

@youngjung
Copy link
Collaborator

youngjung commented Apr 28, 2020

Ah, sorry I missed that part.
Those are our customization to fit region to eye-nose-mouth-chin part.
The region looks like below.
source
x * source
x2 * source
image
Empty part around mouth is not to keep mustache of the source.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants