Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Complete results and a full pretrained model #17

Open
pavanteja295 opened this issue Dec 6, 2018 · 1 comment
Open

Complete results and a full pretrained model #17

pavanteja295 opened this issue Dec 6, 2018 · 1 comment

Comments

@pavanteja295
Copy link

pavanteja295 commented Dec 6, 2018

Hey,
I have read your paper but its unjust not to release a pretrained model for the entire network. I agree you need not release any code base. But promising to do something and failing to do is a bad thing. If you cannnot release the entire pipeline please release the testing framework for testing your model. Im doubtful if the results reported in the paper are reproducable.
Because of such large hyper paramater tuning one will not be able to reproduce exact results as you report.
I think you wont have "license" issue releasing the code for testing the entire pretrained model everyone does it. Atleast point us to the pretrained models you are using.
Its been already approx 6 months from ECCV camera ready. Its high time to release the testing framework for the pretrained model or we would like to take it to the notice of higher authorities.
We will soon open a reddit post regarding the discussion about this paper as a lot of people are facing issues to reproduce the result.

@mkocabas
Copy link
Owner

mkocabas commented Dec 7, 2018

Dear @pavanteja295,

Thanks for your interest in our project. In our paper, PRN is the main contribution to assign keypoints to bounding box instances. We open source it for people who want to compare their assignment methods against ours.

Unfortunately, releasing the whole code is against our contract with the company we're working for, it includes the pretrained models and testing code. We are sorry for that. And we didn't promise for opening the whole pipeline.

Previously, we replied many emails regarding the hyperparameters and details about the training process. And I know some people got similar results to ours. If you have any specific questions about paper or implementation, you can contact us directly.

Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants