Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Many object labels are wrong #51

Closed
sainisanjay opened this issue Mar 23, 2021 · 5 comments
Closed

Many object labels are wrong #51

sainisanjay opened this issue Mar 23, 2021 · 5 comments

Comments

@sainisanjay
Copy link

After visualisation it been observed that many objects labels has wrong values like Truck is annotated as Car and Most of time (Van) is sometime annotated as Car and sometime Truck.
Is it due to manual or human errors?
Few examples:
10
21
2

Further, such object annotated which human eyes also can't recognised
1
20

1st image Truck is annotated as Car
2nd image again Truck is annotated as Car
3rd image Car (Van is European country) is annotated as Truck, however most of images such object is annotated as Car.
4th & 5th image such objects are annotated that can't be recognised by human eyes.

Does BDD trying to correct or improved wrongly annotated objects?

@griffintin
Copy link

Similar situation happened when I try to visualize, lables are indeed wrongly attached in the provided labeling data.

@fyu are you going to check this and update ?

@fyu
Copy link
Contributor

fyu commented Apr 2, 2021

Are you referring to Detection 2020 Labels here?

@sainisanjay
Copy link
Author

@fyu Yes, i am referring Detection 2020 Labels (det_v2_train_release.json and det_v2_val_release.json)

@fyu
Copy link
Contributor

fyu commented Apr 2, 2021

OK. Thanks for letting us know. We will look into them. Those are human annotation errors, which are unavoidable when we have so many images to label. But overall, after our multiple rounds of quality check, the labels should be in a stable state.

@utkutpcgl
Copy link

Thanks for your great contribution!

Is there an update on this issue or a corrected version of Detection 2020 Labels? I also noticed serious labeling issues (regarding rider, motorcycle, and bicycle classes).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants