Hello Codabench team,
I found a ranking issue on the MOT20 Challenge leaderboard for MOT20 Test set submissions.
A submission with no evaluation scores is currently ranked #1, ahead of submissions with valid results.
Current leaderboard entries
Rank 1
Participant: s*****
Date: 2026-07-22 17:58
Submission ID: 857861
Method name: adt
Detection type: Public Detections
Tracker type: Online Tracker
HOTA: n/a
MOTA: n/a
IDF1: n/a
All other evaluation metrics: n/a
Expected behavior
Submissions without valid evaluation results should not be ranked above successfully evaluated submissions. They should either:
be excluded from the leaderboard ranking,
be marked as failed or pending, or
appear below submissions with valid scores.
Actual behavior
Submission 857861, which has n/a for all evaluation metrics, is ranked first on the leaderboard.
Could you please check the leaderboard sorting and handling of submissions with missing evaluation scores?
Thank you.
Hello Codabench team,
I found a ranking issue on the MOT20 Challenge leaderboard for MOT20 Test set submissions.
A submission with no evaluation scores is currently ranked #1, ahead of submissions with valid results.
Current leaderboard entries
Rank 1
Participant: s*****
Date: 2026-07-22 17:58
Submission ID: 857861
Method name: adt
Detection type: Public Detections
Tracker type: Online Tracker
HOTA: n/a
MOTA: n/a
IDF1: n/a
All other evaluation metrics: n/a
Expected behavior
Submissions without valid evaluation results should not be ranked above successfully evaluated submissions. They should either:
be excluded from the leaderboard ranking,
be marked as failed or pending, or
appear below submissions with valid scores.
Actual behavior
Submission 857861, which has n/a for all evaluation metrics, is ranked first on the leaderboard.
Could you please check the leaderboard sorting and handling of submissions with missing evaluation scores?
Thank you.