Room list: Annoying jump of rooms with unread messages first preference

[jaywink]

When sorting by "Activity + Show rooms with unread messages first" there is a rather annoying behaviour.

When clicking the top (unread) room in the list, it stays in place. When then clicking the second room in the list, the third room jumps to be first.

Expectation: The first room would disappear out of the unread messages first and the second room would be first, not second, with the next room in second?

Desktop, Ubuntu 20.04
Nightly 2020110402