Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is deepflux reproducible #8

Closed
Tcorpion opened this issue Jul 31, 2021 · 3 comments
Closed

Is deepflux reproducible #8

Tcorpion opened this issue Jul 31, 2021 · 3 comments

Comments

@Tcorpion
Copy link
Contributor

Follow the deepflux training, I could NOT get skeletons on par with “Deepflux for skeletons in the wild CVPR2019” reported.
The loss always went to 'Nan' in a few steps in training when LR=1e-6, after reducing grad from grad = distL1 * (weightPos + weightNeg) / len(crop) to grad = distL1 * (weightPos + weightNeg) / len(crop) / (weightPos + weightNeg).sum() , here (weightPos + weightNeg).sum() was about 1e4, the loss finally converged.

In fact, the skeletons produced in Deepflux are really bad. For comparison, I trained same deepflux model with skeleton mask instead of flux field, the results were much better than that from flux field.

Did you reproduce the skeleton prediction as paper reported?

@Tcorpion
Copy link
Contributor Author

By the way, after replacing upsampling to deconv2d as Deepflux did, the loss could NOT converge with any values of learning rate.

@sunsmarterjie
Copy link
Owner

Thanks for your efforts ! Training deepflux needs Adam optimizer as my experience. But I still did not reproduce the performance as the paper reported. Welcome to join the project and reproduce deepflux.

@Tcorpion
Copy link
Contributor Author

Tcorpion commented Aug 1, 2021

I adopt adam optimizer and it help converge. The converged model of flux field is NOT on par with skeleton mask training.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants