Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Training from scratch on COCO #3

Open
factplay1 opened this issue May 1, 2020 · 6 comments
Open

Training from scratch on COCO #3

factplay1 opened this issue May 1, 2020 · 6 comments

Comments

@factplay1
Copy link

Thanks for the good work!

Just wanted to mention that I have tried the two most stared EfficientDet PyTorch repos on Github, and neither reproduce the paper results on COCO, not even close.

They mostly claim they train on custom data and port weights from official TF checkpoints, but fail to train from scratch on COCO.

I tried their implementations with 200+ kinds of hyper-parameter tuning sets & settings - yes 200+ jobs!

Very keen to see your completed training on COCO. Looking forward to that.

Cheers

@sevakon
Copy link
Owner

sevakon commented May 1, 2020

Thank you very much for your words! It really motivates me.
I will let you know when everything is ready by commenting on your issue.

Just wondering, what hardware specs do you have? Maybe we could collaborate to obtain checkpoints trained on COCO from scratch on all the models.

Best,
Seva

@factplay1
Copy link
Author

factplay1 commented May 2, 2020

Glad to hear that.
Thank you :)

I have access to cloud and a dozen local GPUs - can run jobs say on 8 X V100 GPUs or lower.
I would be happy to run training jobs, can't however send out any files (corporate limitations). But will be able to write you which set of hyper-parameters lead to what mAP...

@tchaton
Copy link

tchaton commented Oct 1, 2020

Hey @sevakon @factplay1,

We are going to use this code to create an on boarding tutorial within my company to put it on production.
Thanks for the hard work and clean code.

Best regards,
Thomas Chaton.

@sevakon
Copy link
Owner

sevakon commented Oct 1, 2020

@tchaton Excited to hear that!
Please let me know how this one goes!
4 months have passed since I worked on the project, and there are some things that I would have done differently now.
For example, PyTorch-Lihgtning would make the training code much more organized and add seamless multi-GPU and TPU support.

@tchaton
Copy link

tchaton commented Oct 2, 2020

Dear @sevakon,

We are using Pytorch Lightning and it will be integrated within our PL stack :)

By the way, I will be joining PL next week :)

Best T.C

@tchaton
Copy link

tchaton commented Oct 7, 2020

Dear @sevakon,

You should switch to Hydra :)

Best regards,
T.C

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants