Skip to content

Add cdc redo configuration (#15614) #15623

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 4 commits into from
Dec 8, 2023
Merged

Add cdc redo configuration (#15614) #15623

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
1af9289
update ticdc acl
sdojjy May 25, 2023
7ae292a
add cdc redo configuration
sdojjy Dec 7, 2023
d42d2e7
Update ticdc/ticdc-open-api-v2.md
qiancai Dec 7, 2023
60043f9
Update ticdc/ticdc-open-api-v2.md
qiancai Dec 7, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions ticdc/ticdc-changefeed-config.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -174,6 +174,8 @@ encoding-worker-num = 16
flush-worker-num = 8
# redo log 文件的压缩行为，可选值为 "" 和 "lz4"。默认值为 ""，表示不进行压缩。
compression = ""
# redo log 上传单个文件的并发数，默认值为 1，表示禁用并发。
flush-concurrency = 1

# 以下参数仅在下游为 Kafka 时生效。从 v6.5.3 开始支持。
[sink.kafka-config]
Expand Down
2 changes: 2 additions & 0 deletions ticdc/ticdc-open-api-v2.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -290,6 +290,8 @@ curl -X GET http://127.0.0.1:8300/api/v2/health
| `use_file_backend` | `BOOL` 类型，是否将 redo log 存储到本地文件中。（非必选） |
| `encoding_worker_num` | `INT` 类型，redo 模块中编解码 worker 的数量。（非必选）|
|`flush_worker_num` | `INT` 类型，redo 模块中上传文件 worker 的数量。（非必选） |
| `compression` | `STRING` 类型，redo 文件的压缩行为，可选值为 `""` 和 `"lz4"`。默认值为 `""`，表示不进行压缩。（非必选） |
| `flush_concurrency` | `INT` 类型，redo log 上传单个文件的并发数，默认值为 1，表示禁用并发。（非必选） |

`filter` 参数说明如下：

Expand Down
2 changes: 1 addition & 1 deletion ticdc/ticdc-sink-to-kafka.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -134,7 +134,7 @@ URI 中可配置的的参数如下：

TiCDC 能够正常工作所需的最小权限集合如下：

- 对 Topic [资源类型](https://docs.confluent.io/platform/current/kafka/authorization.html#resources)的 `Create` 和 `Write` 权限。
- 对 Topic [资源类型](https://docs.confluent.io/platform/current/kafka/authorization.html#resources)的 `Create` 、`Write` 和 `Describe` 权限。
Copy link
Collaborator

@qiancai qiancai Dec 8, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

备注：这个改动不是在原来的 PR https://github.com/pingcap/docs-cn/pull/15614/files 上新修改的 ，是 cherry-pick 自动带来的。@sdojjy 确认 v6.5 也需要这个改动，所以此处保留了

- 对 Cluster 资源类型的 `DescribeConfigs` 权限。

### TiCDC 集成 Kafka Connect (Confluent Platform)
Expand Down