N/a are displayed on top of the leaderboard

[the1mag]

Hi,

I've noticed that when participants submit submission files with the incorrect name, no score shows up but when they add that submission to the leaderboard, the score shows as n/a and places them above other participants that had actual scores. An example is on this competition where the top 3 places have scores of n/a and rank above scores with 100% accuracy. Here is the link to the leaderboard on that competition: https://www.codabench.org/competitions/7078/#/results-tab

[Didayolo]

Hi @the1mag,

This issue was previously marked as solved:

• n/a scores are ranked higher than numerical values #1284
• Wrong leaderboard ordering and N/a scores discussion #1540

But apparently is still present. Thank you reporting it, we are going to work on it as soon as possible.

[the1mag]

Hi, I just updated to the latest release v1.25 and now results that have N/A show status failed and don't allow adding to the leaderboard so I believe that solves the issue. Thank you

[Didayolo]

I just updated to the latest release v1.25

Just to clarify, you are talking about your compute workers here?

I'll keep the issue open because anyway the N/a scores should always be shown at the bottom of the leaderboard.

[the1mag]

Hi, I updated our code to pull from the latest release and also updated my compute worker to use the latest image.

[Didayolo]

I am not able to reproduce it (at least with this specific competition).

• The "N/a" submissions simply fail, so I can't put them into the leaderboard.
• Another strange thing: the competition is incomplete (empty pages). Not sure how it was created in the first place.

[Didayolo]

Still created a PR to improve the back-end and font-end for the leaderboard and N/a scores (#2337)