Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

流式处理且失效转移时,失效转移的分片项不能执行一次即停止 #74

Closed
peng6812 opened this issue Mar 22, 2016 · 1 comment
Labels

Comments

@peng6812
Copy link

机器一处理5-9分片的数据,机器二处理0-4分片的数据,前提条件:所有分片数据均能一直取到数据,
当机器二down机,进入失效转移阶段,理论上机器一由于一直能取到数据,不会处理失效转移的分片数据,但是机器一会由于重新需要分片,跳出流式处理循环,在下一次execute中,会遇到jobFacade.failoverIfNecessary(); 这样导致会接受分片4的失效转移数据,从而进入4分片的流式处理阶段,导致正常的5-9分片数据得不到处理
image

@terrymanu
Copy link
Member

原因查明:失效转移时,重新触发作业会导致重新分片而清理掉分片标记,导致失效转移的作业不会停止。与原意违背。
原意是想失效转移只执行一次,然后发现需要重新分片的标记而停止流式处理。

@terrymanu terrymanu changed the title 流式处理,失效转移问题 [Bug]流式处理且失效转移时,失效转移的分片项不能执行一次即停止 Mar 28, 2016
@terrymanu terrymanu changed the title [Bug]流式处理且失效转移时,失效转移的分片项不能执行一次即停止 流式处理且失效转移时,失效转移的分片项不能执行一次即停止 Jul 12, 2016
@terrymanu terrymanu added the bug label Jul 12, 2016
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants