New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Accuracy is an invalid metric for SYS-PER-REQ1 #8

Closed

mrksbrg opened this issue Feb 15, 2022 · 1 comment

Assignees

Member

mrksbrg commented Feb 15, 2022

"SYS-PER-REQ1: The pedestrian recognition component shall identify pedestrians with an accuracy of 93% when they are within 50 m."

True positive rate would be a better metric than accuracy, and also align with SYS-PER-REQ2 that specifies the false negative rate.

mrksbrg self-assigned this

Member Author

mrksbrg commented Feb 16, 2022

To avoid redundant requirements, we shall make sure the TPR in SYS-PER-REQ1 and FPR in SYS-PER-REQ2 are calculated for different distance thresholds.

mrksbrg added a commit that referenced this issue


          Update according to Issue #8

d387cd1

mrksbrg closed this as completed

mrksbrg mentioned this issue

Update the 50 m threshold in the performance requirements #10

Closed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment