Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fp32 vs FP16 vs int8 , both fp32 & fp16 having same results & fps? #504

Closed
akashAD98 opened this issue Nov 16, 2021 · 3 comments
Closed

Comments

@akashAD98
Copy link

i have seen your implementation,its by default supports fp16, & I tested the results on frames, there are lots of FP, so what i thout if i used FP32 (which is used in darknet) then there will be improvment in accuracuy.
But FPS & accuracy of both fp16 & fp32 is same.

i turned off fp16 using as per your suggetions #450
builder.fp16_mode = False & converted yolo.onnx into yolo.trt ,
& both speed (FPS) & results are almost same.

i think its not using fp32 . can you explain me how to use fp32

@jkjung-avt
Copy link
Owner

If you are using TensorRT 7+, you'll need to comment out (or delete) this line of code instead.

config.set_flag(trt.BuilderFlag.FP16)

@akashAD98
Copy link
Author

yes it's working fine. but no effect on accuracy, still it's the same. I thought due to FP32 little bit of accuracy will improve.

@jkjung-avt
Copy link
Owner

The accuracy issue (mAP drop for TensorRT YOLO engines) has been summarized/tracked in #315.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants