[Improvement] [Master] task instance becomes in a state 【Need fault tolerance】

[xuchunlai]

Search before asking

• I had searched in the issues and found no similar issues.

What happened

There are two master nodes and two worker nodes.
Stop the worker node while the task is executing，task instance becomes in a state [Need fault tolerance] ,The task is resumed only after the Master node is restarted.

What you expected to happen

If a worker node is down when a task is running, the task can be assigned to another worker node for execution.

How to reproduce

Stop the worker node while the task is executing.

Anything else

No response

Version

2.0.6

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[github-actions]

Thank you for your feedback, we have received your issue, Please wait patiently for a reply.

• In order for us to understand your request as soon as possible, please provide detailed information、version or pictures.
• If you haven't received a reply for a long time, you can join our slack and send your question to channel #troubleshooting

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

[github-actions]

This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.