No job offers were sent due to rolling update

[robszumski]

After a rolling update, job offers were not sent out when one of the machines went down. list-units still showed an old machine running the units. The etcd cluster was not affected by this update other than a leader election.

Starting and stopping the units fixed the problem.

[bcwaldon]

When the one machine rebooted, it should have caused a MachineRemoved event to go out to the rest of the cluster. One of those other machines should have responded accordingly by cleaning up that now-removed machine's artifacts from the cluster (including the defunct job states).

I'm not sure why this didn't happen, but it could have been due to a race with the leader election.

Still something to look into.

[bcwaldon]

This might actually be due to the same root cause of #149

[bcwaldon]

Closing as dupe of #149 as fix is in hand. Please reopen if the problem persists.