Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Could you share the 3 class results with 20% training data? #11

Closed
pigtigger opened this issue Feb 10, 2022 · 1 comment
Closed

Could you share the 3 class results with 20% training data? #11

pigtigger opened this issue Feb 10, 2022 · 1 comment

Comments

@pigtigger
Copy link

I am curious about the performance gain on vehicle for both 1f && 3f model with 20% training data,
so could you provide the results , cause I dont have enough GPUs to train it now.

@Abyssaledge
Copy link
Collaborator

Abyssaledge commented Feb 10, 2022

The given config sst_waymoD5_1x_3class_12heads could achieve:

Vehicle/L1 mAP: 0.6725, Vehicle/L1 mAPH: 0.6670, Vehicle/L2 mAP: 0.5881, Vehicle/L2 mAPH: 0.5832,
Pedestrian/L1 mAP: 0.7346, Pedestrian/L1 mAPH: 0.6057, Pedestrian/L2 mAP: 0.6492, Pedestrian/L2 mAPH: 0.5337,
Sign/L1 mAP: 0.0000, Sign/L1 mAPH: 0.0000, Sign/L2 mAP: 0.0000, Sign/L2 mAPH: 0.0000,
Cyclist/L1 mAP: 0.6321, Cyclist/L1 mAPH: 0.6182, Cyclist/L2 mAP: 0.6086, Cyclist/L2 mAPH: 0.5951,
Overall/L1 mAP: 0.6797, Overall/L1 mAPH: 0.6303, Overall/L2 mAP: 0.6153, Overall/L2 mAPH: 0.5707

If you using the 8-head counterpart, Vehicle/L1 mAP should be 1 mAP lower.
For 3 frame and 8-head, Vehicle/L1 mAP is around 69.5. So multi-frame model could obtain ~3 mAP with 20% training data on L1 Vehicle.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants