Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug][Sort] Duplicated chunk happens when open scan-newly-added-table in mysql-cdc #7857

Closed
2 tasks done
EMsnap opened this issue Apr 14, 2023 · 0 comments · Fixed by #7859
Closed
2 tasks done

[Bug][Sort] Duplicated chunk happens when open scan-newly-added-table in mysql-cdc #7857

EMsnap opened this issue Apr 14, 2023 · 0 comments · Fixed by #7859
Assignees
Labels
component/sort type/bug Something is wrong
Milestone

Comments

@EMsnap
Copy link
Contributor

EMsnap commented Apr 14, 2023

What happened

this bug happens when

1、open scan.newly-added-table.enabled in mysql source
2、running in snapshot phase
3、stop and restart the job

The chunks that generated before stop will be generated again in the second start
So the data will be duplicated

企业微信截图_02e32d7f-d914-45c6-9b2b-aeaee4019996

What you expected to happen

no duplicated chunk

How to reproduce

see section 1

Environment

No response

InLong version

master

InLong Component

InLong Sort

Are you willing to submit PR?

  • Yes, I am willing to submit a PR!

Code of Conduct

@EMsnap EMsnap added the type/bug Something is wrong label Apr 14, 2023
@healchow healchow changed the title [Bug] duplicated chunk happens when open scan-newly-added-table in mysql-cdc [Bug][Sort] Duplicated chunk happens when open scan-newly-added-table in mysql-cdc Apr 14, 2023
@healchow healchow added this to the 1.7.0 milestone Apr 14, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
component/sort type/bug Something is wrong
Projects
None yet
2 participants