Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BFlops is not the same as the results reported in the paper. #51

Closed
tingtingliangvs opened this issue Mar 26, 2020 · 2 comments
Closed

Comments

@tingtingliangvs
Copy link

Hi there! Excellent work and thank you for sharing the code!
I have a question about BFlops calculation. I used the efficientdet/model_inspect.py to compute the Efficientdet-D5 flops and got 270.77BFlops, which is about twice the 135 BFlops reported in paper.
Our results,
image
Reported in EfficientDet
截屏2020-03-26下午12 04 29

What's more, I noticed that with a unified unit (BFlops), the number of Flops of NAS-FPN is also half of that reported in your paper.
Reported in NAS-FPN,
2031585191959_ pic
Reported in EfficientDet,
1585195071970
It would be great if you could solve my confusion. Thanks a lot!

@mingxingtan
Copy link
Member

Hi @LiangTinting , you are right the reported FLOPS in the code is about twice larger than the paper.

This is because the EfficientDet paper uses FLOPS to denote "number of multiply-adds" (see page 1 footnote), where each "multiply-add" is counted as 2 ops in the code. However, in the NAS-FPN paper, FLOPs denotes number of operations, same as the code.

I had a hard time to pick which way to go, but somehow we decided to use FLOPs to denote "number of multiple-adds", following the convention of many previous work.

Sorry for the confusion, but I hope it answers your question.

@mingxingtan
Copy link
Member

I am going to close this issue, but feel free to reopen it or add more comments. Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants