Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

adds create_target_heatmap and tests #134

Merged
merged 1 commit into from Jun 13, 2019
Merged

Conversation

siarez
Copy link
Contributor

@siarez siarez commented May 15, 2019

create_target_heatmap() is useful for people who want to fine-tune or train the model from scratch. Figuring it out was not trivial, so I thought it will save people time. It addresses #128

@1adrianb
Copy link
Owner

Thanks a lot, sorry for delay!

@1adrianb 1adrianb merged commit 719511a into 1adrianb:master Jun 13, 2019
@flyduck
Copy link

flyduck commented Nov 19, 2019

@siarez I read your code for create the target heatmap, but I have some question for this: your bbox is not 256256, you get the heat map is 6464, how to make the heat map get point in the bbox? Its say your bbox will resize to 256*256 to train, I cant understand that. could you help to explain that? Thanks!

@siarez
Copy link
Contributor Author

siarez commented Nov 19, 2019

@flyduck FAN outputs 64x64 heatmaps, even tough the input image is 256x256. That's why the target heatmaps are 64x64.

@flyduck
Copy link

flyduck commented Nov 21, 2019

@siarez thank you for your answer. I have another question, did you do some data enhance for the train data? such as rotation, scale, transform?

@siarez
Copy link
Contributor Author

siarez commented Nov 21, 2019

@flyduck I didn't, but it sounds like a good idea. You can look at the original lua code for FAN to see if they did it originally.

@flyduck
Copy link

flyduck commented Nov 26, 2019

@siarez thank you very much! I use your code to generate the 646468 heat map, and then I use the "get_preds_fromhm" function to get the cordinate from the gt heat map, but the point is some like not really correct, have you do some experiment like this?

@siarez
Copy link
Contributor Author

siarez commented Nov 26, 2019

@flyduck what do you mean by not really correct?

@flyduck
Copy link

flyduck commented Nov 27, 2019

@siarez Its means that when I use the gt heat map by the function "get_preds_fromhm" to get landmark in the ori image, the landmark is not the same as the GT.

@siarez
Copy link
Contributor Author

siarez commented Nov 27, 2019

@flyduck Hmm, you will loose some accuracy due to quantization. Because your landmarks coordinates are scaled down from their original scale to fit the 64x64 grid.
To make sure nothing fishy is going on, check the mean of the error residuals. It should be close to zero.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants