Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

weird evaluation results #14

Open
rpc-group opened this issue Dec 18, 2022 · 1 comment
Open

weird evaluation results #14

rpc-group opened this issue Dec 18, 2022 · 1 comment

Comments

@rpc-group
Copy link

Hello,
I tried to run the evaluation and obtained

2022-12-18 15:10:19,793 : average mAP:
I1218 15:10:19.793995 140695683121408 evaluate.py:162] average mAP:
2022-12-18 15:10:19,794 : 3D IoU at 25: 48.1
I1218 15:10:19.794512 140695683121408 evaluate.py:162] 3D IoU at 25: 48.1
2022-12-18 15:10:19,794 : 3D IoU at 50: 0.0
I1218 15:10:19.794570 140695683121408 evaluate.py:162] 3D IoU at 50: 0.0
2022-12-18 15:10:19,794 : 3D IoU at 75: 0.0
I1218 15:10:19.794611 140695683121408 evaluate.py:162] 3D IoU at 75: 0.0
2022-12-18 15:10:19,794 : 5 degree, 2cm: 0.0
I1218 15:10:19.794649 140695683121408 evaluate.py:162] 5 degree, 2cm: 0.0
2022-12-18 15:10:19,794 : 5 degree, 5cm: 0.0
I1218 15:10:19.794685 140695683121408 evaluate.py:162] 5 degree, 5cm: 0.0
2022-12-18 15:10:19,794 : 10 degree, 2cm: 0.0
I1218 15:10:19.794721 140695683121408 evaluate.py:162] 10 degree, 2cm: 0.0
2022-12-18 15:10:19,794 : 10 degree, 5cm: 0.0
I1218 15:10:19.794758 140695683121408 evaluate.py:162] 10 degree, 5cm: 0.0
2022-12-18 15:10:19,794 : 10 degree, 10cm: 0.0
I1218 15:10:19.794793 140695683121408 evaluate.py:162] 10 degree, 10cm: 0.0
2022-12-18 15:10:19,794 : category bottle
I1218 15:10:19.794828 140695683121408 evaluate.py:162] category bottle
2022-12-18 15:10:19,794 : mAP:
I1218 15:10:19.794862 140695683121408 evaluate.py:162] mAP:
2022-12-18 15:10:19,794 : 3D IoU at 25: 40.1
I1218 15:10:19.794898 140695683121408 evaluate.py:162] 3D IoU at 25: 40.1
2022-12-18 15:10:19,794 : 3D IoU at 50: 0.0
I1218 15:10:19.794933 140695683121408 evaluate.py:162] 3D IoU at 50: 0.0
2022-12-18 15:10:19,794 : 3D IoU at 75: 0.0
I1218 15:10:19.794968 140695683121408 evaluate.py:162] 3D IoU at 75: 0.0
2022-12-18 15:10:19,795 : 5 degree, 2cm: 0.0
I1218 15:10:19.795003 140695683121408 evaluate.py:162] 5 degree, 2cm: 0.0
2022-12-18 15:10:19,795 : 5 degree, 5cm: 0.0
I1218 15:10:19.795037 140695683121408 evaluate.py:162] 5 degree, 5cm: 0.0
2022-12-18 15:10:19,795 : 10 degree, 2cm: 0.0
I1218 15:10:19.795072 140695683121408 evaluate.py:162] 10 degree, 2cm: 0.0
2022-12-18 15:10:19,795 : 10 degree, 5cm: 0.0
I1218 15:10:19.795106 140695683121408 evaluate.py:162] 10 degree, 5cm: 0.0
2022-12-18 15:10:19,795 : 10 degree, 10cm: 0.0
I1218 15:10:19.795141 140695683121408 evaluate.py:162] 10 degree, 10cm: 0.0
2022-12-18 15:10:19,795 : category bowl
I1218 15:10:19.795175 140695683121408 evaluate.py:162] category bowl
2022-12-18 15:10:19,795 : mAP:
I1218 15:10:19.795209 140695683121408 evaluate.py:162] mAP:
2022-12-18 15:10:19,795 : 3D IoU at 25: 83.0
I1218 15:10:19.795244 140695683121408 evaluate.py:162] 3D IoU at 25: 83.0
2022-12-18 15:10:19,795 : 3D IoU at 50: 0.0
I1218 15:10:19.795278 140695683121408 evaluate.py:162] 3D IoU at 50: 0.0
2022-12-18 15:10:19,795 : 3D IoU at 75: 0.0
I1218 15:10:19.795313 140695683121408 evaluate.py:162] 3D IoU at 75: 0.0
2022-12-18 15:10:19,795 : 5 degree, 2cm: 0.0
I1218 15:10:19.795347 140695683121408 evaluate.py:162] 5 degree, 2cm: 0.0
2022-12-18 15:10:19,795 : 5 degree, 5cm: 0.0
I1218 15:10:19.795381 140695683121408 evaluate.py:162] 5 degree, 5cm: 0.0
2022-12-18 15:10:19,795 : 10 degree, 2cm: 0.0
I1218 15:10:19.795415 140695683121408 evaluate.py:162] 10 degree, 2cm: 0.0
2022-12-18 15:10:19,795 : 10 degree, 5cm: 0.0
I1218 15:10:19.795450 140695683121408 evaluate.py:162] 10 degree, 5cm: 0.0
2022-12-18 15:10:19,795 : 10 degree, 10cm: 0.0
I1218 15:10:19.795485 140695683121408 evaluate.py:162] 10 degree, 10cm: 0.0
2022-12-18 15:10:19,795 : category camera
I1218 15:10:19.795519 140695683121408 evaluate.py:162] category camera
2022-12-18 15:10:19,795 : mAP:
I1218 15:10:19.795553 140695683121408 evaluate.py:162] mAP:
2022-12-18 15:10:19,795 : 3D IoU at 25: 52.1
I1218 15:10:19.795587 140695683121408 evaluate.py:162] 3D IoU at 25: 52.1
2022-12-18 15:10:19,795 : 3D IoU at 50: 0.0
I1218 15:10:19.795621 140695683121408 evaluate.py:162] 3D IoU at 50: 0.0
2022-12-18 15:10:19,795 : 3D IoU at 75: 0.0
I1218 15:10:19.795656 140695683121408 evaluate.py:162] 3D IoU at 75: 0.0
2022-12-18 15:10:19,795 : 5 degree, 2cm: 0.0
I1218 15:10:19.795690 140695683121408 evaluate.py:162] 5 degree, 2cm: 0.0
2022-12-18 15:10:19,795 : 5 degree, 5cm: 0.0
I1218 15:10:19.795733 140695683121408 evaluate.py:162] 5 degree, 5cm: 0.0
2022-12-18 15:10:19,795 : 10 degree, 2cm: 0.0
I1218 15:10:19.795767 140695683121408 evaluate.py:162] 10 degree, 2cm: 0.0
2022-12-18 15:10:19,795 : 10 degree, 5cm: 0.0
I1218 15:10:19.795802 140695683121408 evaluate.py:162] 10 degree, 5cm: 0.0
2022-12-18 15:10:19,795 : 10 degree, 10cm: 0.0
I1218 15:10:19.795836 140695683121408 evaluate.py:162] 10 degree, 10cm: 0.0
2022-12-18 15:10:19,795 : category can
I1218 15:10:19.795870 140695683121408 evaluate.py:162] category can
2022-12-18 15:10:19,795 : mAP:
I1218 15:10:19.795905 140695683121408 evaluate.py:162] mAP:
2022-12-18 15:10:19,795 : 3D IoU at 25: 49.3
I1218 15:10:19.795939 140695683121408 evaluate.py:162] 3D IoU at 25: 49.3
2022-12-18 15:10:19,795 : 3D IoU at 50: 0.0
I1218 15:10:19.795973 140695683121408 evaluate.py:162] 3D IoU at 50: 0.0
2022-12-18 15:10:19,796 : 3D IoU at 75: 0.0
I1218 15:10:19.796007 140695683121408 evaluate.py:162] 3D IoU at 75: 0.0
2022-12-18 15:10:19,796 : 5 degree, 2cm: 0.0
I1218 15:10:19.796042 140695683121408 evaluate.py:162] 5 degree, 2cm: 0.0
2022-12-18 15:10:19,796 : 5 degree, 5cm: 0.0
I1218 15:10:19.796077 140695683121408 evaluate.py:162] 5 degree, 5cm: 0.0
2022-12-18 15:10:19,796 : 10 degree, 2cm: 0.0
I1218 15:10:19.796111 140695683121408 evaluate.py:162] 10 degree, 2cm: 0.0
2022-12-18 15:10:19,796 : 10 degree, 5cm: 0.0
I1218 15:10:19.796145 140695683121408 evaluate.py:162] 10 degree, 5cm: 0.0
2022-12-18 15:10:19,796 : 10 degree, 10cm: 0.0
I1218 15:10:19.796179 140695683121408 evaluate.py:162] 10 degree, 10cm: 0.0
2022-12-18 15:10:19,796 : category laptop
I1218 15:10:19.796213 140695683121408 evaluate.py:162] category laptop
2022-12-18 15:10:19,796 : mAP:
I1218 15:10:19.796247 140695683121408 evaluate.py:162] mAP:
2022-12-18 15:10:19,796 : 3D IoU at 25: 0.0
I1218 15:10:19.796282 140695683121408 evaluate.py:162] 3D IoU at 25: 0.0
2022-12-18 15:10:19,796 : 3D IoU at 50: 0.0
I1218 15:10:19.796316 140695683121408 evaluate.py:162] 3D IoU at 50: 0.0
2022-12-18 15:10:19,796 : 3D IoU at 75: 0.0
I1218 15:10:19.796351 140695683121408 evaluate.py:162] 3D IoU at 75: 0.0
2022-12-18 15:10:19,796 : 5 degree, 2cm: 0.0
I1218 15:10:19.796385 140695683121408 evaluate.py:162] 5 degree, 2cm: 0.0
2022-12-18 15:10:19,796 : 5 degree, 5cm: 0.0
I1218 15:10:19.796419 140695683121408 evaluate.py:162] 5 degree, 5cm: 0.0
2022-12-18 15:10:19,796 : 10 degree, 2cm: 0.0
I1218 15:10:19.796454 140695683121408 evaluate.py:162] 10 degree, 2cm: 0.0
2022-12-18 15:10:19,796 : 10 degree, 5cm: 0.0
I1218 15:10:19.796489 140695683121408 evaluate.py:162] 10 degree, 5cm: 0.0
2022-12-18 15:10:19,796 : 10 degree, 10cm: 0.0
I1218 15:10:19.796523 140695683121408 evaluate.py:162] 10 degree, 10cm: 0.0
2022-12-18 15:10:19,796 : category mug
I1218 15:10:19.796557 140695683121408 evaluate.py:162] category mug
2022-12-18 15:10:19,796 : mAP:
I1218 15:10:19.796592 140695683121408 evaluate.py:162] mAP:
2022-12-18 15:10:19,796 : 3D IoU at 25: 64.3
I1218 15:10:19.796626 140695683121408 evaluate.py:162] 3D IoU at 25: 64.3
2022-12-18 15:10:19,796 : 3D IoU at 50: 0.0
I1218 15:10:19.796661 140695683121408 evaluate.py:162] 3D IoU at 50: 0.0
2022-12-18 15:10:19,796 : 3D IoU at 75: 0.0
I1218 15:10:19.796695 140695683121408 evaluate.py:162] 3D IoU at 75: 0.0
2022-12-18 15:10:19,796 : 5 degree, 2cm: 0.0
I1218 15:10:19.796730 140695683121408 evaluate.py:162] 5 degree, 2cm: 0.0
2022-12-18 15:10:19,796 : 5 degree, 5cm: 0.0
I1218 15:10:19.796765 140695683121408 evaluate.py:162] 5 degree, 5cm: 0.0
2022-12-18 15:10:19,796 : 10 degree, 2cm: 0.0
I1218 15:10:19.796799 140695683121408 evaluate.py:162] 10 degree, 2cm: 0.0
2022-12-18 15:10:19,796 : 10 degree, 5cm: 0.0
I1218 15:10:19.796833 140695683121408 evaluate.py:162] 10 degree, 5cm: 0.0
2022-12-18 15:10:19,796 : 10 degree, 10cm: 0.0
I1218 15:10:19.796868 140695683121408 evaluate.py:162] 10 degree, 10cm: 0.0

I think there are something wrong here. Most of the values are zero. Any suggestions to correct it? and may I know what is the expected evaluation results please?
@605521553
Copy link

have you finished this problem？i face the same one too

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@605521553 @rpc-group