Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Tracking issue for refactor sink #5928

Closed
hi-rustin opened this issue Jun 20, 2022 · 5 comments · Fixed by #7737
Closed

Tracking issue for refactor sink #5928

hi-rustin opened this issue Jun 20, 2022 · 5 comments · Fixed by #7737
Assignees
@hicqu @hi-rustin
Labels
affects-6.5 area/ticdc Issues or PRs related to TiCDC. component/sink Sink component. type/feature Issues about a new feature

Comments

@hi-rustin
Copy link
Member

hi-rustin commented Jun 20, 2022 •
edited
Loading

Implement MQ sink and MySQL sink in asynchronous mode to improve the throughput of the sink and reduce the coupling of modules.
@hi-rustin hi-rustin added component/sink Sink component. area/ticdc Issues or PRs related to TiCDC. type/feature Issues about a new feature labels Jun 20, 2022
@hi-rustin hi-rustin mentioned this issue Jun 20, 2022
Closed
@CharlesCheung96 CharlesCheung96 mentioned this issue Jun 23, 2022
Merged
@hi-rustin hi-rustin mentioned this issue Jun 23, 2022
Merged
ti-chi-bot pushed a commit that referenced this issue Jun 27, 2022
@hi-rustin
sinkv2(ticdc): add interfaces (#6017)
e4bab46 
ref #5928
This was referenced Jun 28, 2022
Merged
Merged
ti-chi-bot pushed a commit that referenced this issue Jun 28, 2022
@hi-rustin
sinkv2(ticdc): fix progress can not advance issue and add tests (#6106)
764f174 
ref #5928
ti-chi-bot pushed a commit that referenced this issue Jun 29, 2022
@hi-rustin
sinkv2(ticdc): impl TxnEventAppender and add tests (#6109)
18e40b5 
ref #5928
@hi-rustin hi-rustin mentioned this issue Jun 29, 2022
Merged
ti-chi-bot pushed a commit that referenced this issue Jul 1, 2022
@hi-rustin
sinkv2(ticdc): fix update resolved ts not taking effect issue (#6118)
187b402 
ref #5928
This was referenced Jul 4, 2022
Merged
Merged
ti-chi-bot pushed a commit that referenced this issue Jul 6, 2022
@hi-rustin
sink(ticdc): remove usless ReplicaID field (#6197)
13264dd 
ref #5928
ti-chi-bot pushed a commit that referenced this issue Jul 6, 2022
@hi-rustin
sink/mq(ticdc): split json.go and add callback (#6176)
b813e1b 
ref #5928
@hi-rustin hi-rustin mentioned this issue Jul 11, 2022
Merged
ti-chi-bot pushed a commit that referenced this issue Jul 11, 2022
@hi-rustin
sink(ticdc): refactor canal and canal-json protocols and support call…
3451572 
…back (#6244)

ref #5928
@hi-rustin hi-rustin mentioned this issue Jul 12, 2022
Merged
ti-chi-bot pushed a commit that referenced this issue Jul 12, 2022
@hi-rustin
sink(ticdc): split maxwell.go and craft.go and support callback (#6263)
3604ffd 
ref #5928
This was referenced Jul 15, 2022
Merged
Merged
ti-chi-bot pushed a commit that referenced this issue Jul 15, 2022
@hi-rustin
test(ticdc): refine test case data col type (#6285)
a28d1b1 
ref #5928
@hicqu hicqu mentioned this issue Jul 15, 2022
Merged
@hi-rustin hi-rustin mentioned this issue Jul 19, 2022
Merged
ti-chi-bot pushed a commit that referenced this issue Jul 20, 2022
@hi-rustin
sinkv2(ticdc): make event sink close waiting for all callbacks be cal…
1945f04 
…led (#6344)

ref #5928
ti-chi-bot pushed a commit that referenced this issue Jul 20, 2022
@hi-rustin
sinkv2(ticdc): impl mq sink (#6288)
ca72baf 
ref #5928
ti-chi-bot pushed a commit that referenced this issue Nov 30, 2022
@hi-rustin
processor/sinkmanager(ticdc): background GC sort engine data (#7737)
519c6f0 
close #5928
@hi-rustin hi-rustin reopened this Nov 30, 2022
@hicqu hicqu mentioned this issue Dec 1, 2022
Merged
ti-chi-bot pushed a commit that referenced this issue Dec 1, 2022
@hicqu
processsor/sinkmanager(ticdc): add some metrics for pull-based-sink (#…
8579aaf 
…7761)

ref #5928
ti-chi-bot pushed a commit that referenced this issue Dec 1, 2022
@hi-rustin
processor/sourcemanager(ticdc): add sorter stats (#7748)
9c3eddb 
ref #5928
@hi-rustin hi-rustin mentioned this issue Dec 1, 2022
Merged
ti-chi-bot pushed a commit that referenced this issue Dec 1, 2022
@hi-rustin
processor/sourcemanager(ticdc): move mounted iter into sourceManager (#…
5f624b7 
…7769)

ref #5928
This was referenced Dec 2, 2022
Merged
Closed
@amyangfei amyangfei mentioned this issue Dec 9, 2022
Merged
ti-chi-bot pushed a commit that referenced this issue Dec 9, 2022
@amyangfei
metrics(ticdc): refine exp boundary, record large row from 2k size (#…
7aef2a0 
…7861)

ref #5928
@ti-chi-bot ti-chi-bot mentioned this issue Dec 9, 2022
Merged
@CharlesCheung96 CharlesCheung96 mentioned this issue Dec 9, 2022
Merged
ti-chi-bot pushed a commit that referenced this issue Dec 17, 2022
@CharlesCheung96
sinkv2(cdc): fix sinkv2 grafana (#7868)
31a235f 
ref #5928
@ti-chi-bot ti-chi-bot mentioned this issue Dec 17, 2022
Merged
@hicqu hicqu mentioned this issue Dec 21, 2022
Merged
ti-chi-bot pushed a commit that referenced this issue Dec 21, 2022
@hicqu
sinkv2(cdc): add some pull-based-sink metrics (#7947)
eb8952d 
ref #5928
@nongfushanquan
Copy link
Contributor

/label affects-6.5

ti-chi-bot added a commit that referenced this issue Jan 6, 2023
@ti-chi-bot
metrics(ticdc): refine exp boundary, record large row from 2k size (#…
e201f10 
…7861) (#7867)

ref #5928
ti-chi-bot added a commit that referenced this issue Jan 6, 2023
@ti-chi-bot
sinkv2(cdc): fix sinkv2 grafana (#7868) (#7930)
b99b726 
ref #5928
@CharlesCheung96 CharlesCheung96 mentioned this issue Jan 6, 2023
Merged
ti-chi-bot pushed a commit that referenced this issue Jan 6, 2023
@CharlesCheung96
sinkv2(ticdc): remove redundant nextToMount in MountedEventIter (#8030)
f9dcb23 
ref #5928
@ti-chi-bot ti-chi-bot mentioned this issue Jan 6, 2023
Merged
ti-chi-bot added a commit that referenced this issue Jan 6, 2023
@ti-chi-bot
sinkv2(ticdc): remove redundant nextToMount in MountedEventIter (#8030)…
a4b5efa 
… (#8033)

ref #5928
@hicqu hicqu mentioned this issue Jan 11, 2023
Closed
@amyangfei amyangfei mentioned this issue Jan 30, 2023
Open
@hicqu hicqu closed this as completed Feb 2, 2023
@nongfushanquan nongfushanquan mentioned this issue Feb 13, 2023
Merged
14 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@hicqu hicqu

@hi-rustin hi-rustin

Labels
affects-6.5 area/ticdc Issues or PRs related to TiCDC. component/sink Sink component. type/feature Issues about a new feature
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

processor/sinkmanager(ticdc): background GC sort engine data hi-rustin/tiflow
4 participants
@hicqu @hi-rustin @ti-chi-bot @nongfushanquan