If a supervisor fails after starting a task, it will pick up another task and execute it.

[bmc-msft]

Information

• Onefuzz version: 1.0.0
• OS: linux

Provide detailed reproduction steps (if any)

1. Start task
2. Wait until it's running on a node
3. Login to node (debug ssh works here)
4. Update service to raise an Exception in the agent callback URL handlers
5. Wait until supervisor exits due to HTTP errors
6. Undo change in step 4.
7. Watch supervisor restart and pick up a new task.

Expected result

Supervisor picks up a new task for the node, even though it's already running one

Actual result

Supervisor is resilient to http comms issues and has multiple retry attempts with backoff logic.

[bmc-msft]

This is done.