Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug][master] When the master receives the result from the worker, the master just stops. After the master restarts, the workflow status is always executing #3616

Closed
xingchun-chen opened this issue Aug 27, 2020 · 4 comments · Fixed by #3776
Assignees
Labels
bug Something isn't working
Milestone

Comments

@xingchun-chen
Copy link
Contributor

xingchun-chen commented Aug 27, 2020

1.run workflow
2.When the master receives the feedback from the worker, the master just stops. After the master restarts, the workflow status is always executing,and the workflow can't be stop
当worker向master发送执行结果的时候,master刚好被挂掉,重启master后,工作流及任务状态一直为进行中,且工作流无法停止
The master log is as follows (master日志如下)
image
The worker log is as follows (worker日志如下)
image
image

Which version of Dolphin Scheduler:
-[1.3.2-release]

@xingchun-chen xingchun-chen added the bug Something isn't working label Aug 27, 2020
@xingchun-chen xingchun-chen added this to the 1.3.3-release milestone Aug 28, 2020
@qiaozhanwei qiaozhanwei assigned qiaozhanwei and unassigned lenboo Aug 31, 2020
@qiaozhanwei
Copy link
Contributor

OK,I will check and fix worker communicate for master with synchronize

@xingchun-chen xingchun-chen changed the title [Bug][master] When the master receives the feedback from the worker, the master just stops. After the master restarts, the workflow status is always executing [Bug][master] When the master receives the resuilt from the worker, the master just stops. After the master restarts, the workflow status is always executing Sep 2, 2020
@xingchun-chen xingchun-chen changed the title [Bug][master] When the master receives the resuilt from the worker, the master just stops. After the master restarts, the workflow status is always executing [Bug][master] When the master receives the result from the worker, the master just stops. After the master restarts, the workflow status is always executing Sep 2, 2020
@xingchun-chen
Copy link
Contributor Author

xingchun-chen commented Sep 3, 2020

@qiaozhanwei Worker updates the master status synchronously

@qiaozhanwei
Copy link
Contributor

qiaozhanwei commented Sep 15, 2020

renew design architecture
12

@xingchun-chen
Copy link
Contributor Author

  1. first, run workflow A , workflow instance A is in execution, stop master service

  2. Restart the master service , after successful execution of workflow instance A, delete workflow instance A

  3. second, run workflow A again, workflow instance B is in execution, stop master service

  4. Restart the master service, the master service has been receiving the success message of deleted task 90, as shown in the figure below, taskInstanceId=90 is the task of workflow instance A
    image
    image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
3 participants