a question about score value in PredictionsTextFile export

[fcakyon]

Thanks for this great library 👍

I'm wondering why is here the prediction score of the detection is exported as -1?

norfair/norfair/metrics.py

Line 93 in 4d59a4d

+ ",-1,-1,-1,-1"

[joaqo]

Thanks! @aguscas you may have some insight on this.

[aguscas]

Hello there! We are not using the confidence score of the detections during the evaluations. If you set that score to be anything greater or equal to -1, the evaluation will return the same results. If you set it to something less than -1, that specific prediction will be ignored during the evaluation. What I mean is that, it doesn't really matter to which number you set that confidence value, as long as it is greater or equal to -1

[fcakyon]

@aguscas thanks for your response!

In this comment you mentioned that when score is 0, that detection will be ignored during evaluation: #42 (comment).

That got me a bit confused. Are detections with score of 0 ignored or only detections with -1 are being ignored?

[aguscas]

If you set to 0 the confidence in your ground truth files, then that object will be ignored. So there are 2 confidence values, one thing is the confidence value in your trackers (which we set to -1), and another thing is the confidence value in the ground truth labels (which is set to 1 when you want to take that object into account in the evaluation, or 0 otherwise).

[fcakyon]

@aguscas thanks a lot, that clears all things up!

One last question. Are there any more differences between tracker output and ground truth or is this all i need to know while arranging ground truths and tracker outputs?

[aguscas]

I think everything else is exactly the same

[dekked]

Thanks @aguscas for the help, we definitely need to do a better job at documenting some parts of this :)