Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug][Sort] Hang up reader in snapshot phase when reducing paralleism #7855

Closed
2 tasks done
EMsnap opened this issue Apr 14, 2023 · 0 comments · Fixed by #7856
Closed
2 tasks done

[Bug][Sort] Hang up reader in snapshot phase when reducing paralleism #7855

EMsnap opened this issue Apr 14, 2023 · 0 comments · Fixed by #7856
Assignees
Labels
component/sort type/bug Something is wrong
Milestone

Comments

@EMsnap
Copy link
Contributor

EMsnap commented Apr 14, 2023

What happened

This bug happends when:
1、sort task runs in multi paralleism
2、sort task running in snapshot phase running mysql cdc
3、stop job and reduce paralleism and restart

the task will read one chunk and then read another one
the log tells that a binlog client starts twice
and then the second chunk won't be processed anymore

image

What you expected to happen

no hang up reader in snapshot phase when reducing paralleism

How to reproduce

This bug happends when:
1、sort task runs in multi paralleism
2、sort task running in snapshot phase running mysql cdc
3、stop job and reduce paralleism and restart

Environment

No response

InLong version

master

InLong Component

InLong Sort

Are you willing to submit PR?

  • Yes, I am willing to submit a PR!

Code of Conduct

@EMsnap EMsnap added the type/bug Something is wrong label Apr 14, 2023
@healchow healchow changed the title [Bug] Sort hang up reader in snapshot phase when reducing paralleism [Bug][Sort] Hang up reader in snapshot phase when reducing paralleism Apr 14, 2023
@healchow healchow added this to the 1.7.0 milestone Apr 14, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
component/sort type/bug Something is wrong
Projects
None yet
2 participants