Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

添加flink连接同步timeout #298

Closed
zyczw opened this issue Jan 15, 2024 · 2 comments
Closed

添加flink连接同步timeout #298

zyczw opened this issue Jan 15, 2024 · 2 comments
Labels
enhancement New feature or request
Milestone

Comments

@zyczw
Copy link

zyczw commented Jan 15, 2024

mysql -> doris 由于目标端doris在夜晚load 比较高,导致doris connnector 执行streamload 超时导致丢失数据。
期望在doris sink 端配置超时时间,或者,添加执行streamload 失败重试机制

@zyczw
Copy link
Author

zyczw commented Jan 15, 2024

image
通过配置这个timeout参数,设置flink写入sink端的超时时间

@baisui1981 baisui1981 added the enhancement New feature or request label Jan 16, 2024
@baisui1981 baisui1981 added this to the v4.0.0 milestone Jan 16, 2024
@baisui1981
Copy link
Member

ChunjunDorisSinkFactory 中添加以下三个参数,用户可以自行定义连接超时异常处理参数

    @FormField(ordinal = 13, advance = true, type = FormFieldType.INT_NUMBER, validate = {Validator.require})
    public Integer connectTimeout;// = loadConf.getRequestConnectTimeoutMs() == null ? DORIS_REQUEST_CONNECT_TIMEOUT_MS_DEFAULT : loadConf.getRequestConnectTimeoutMs();
    @FormField(ordinal = 14, advance = true, type = FormFieldType.INT_NUMBER, validate = {Validator.require})
    public Integer socketTimeout;// = loadConf.getRequestReadTimeoutMs() == null ? DORIS_REQUEST_READ_TIMEOUT_MS_DEFAULT : loadConf.getRequestReadTimeoutMs();
    @FormField(ordinal = 15, advance = true, type = FormFieldType.INT_NUMBER, validate = {Validator.require})
    public Integer retries;// = loadConf.getRequestRetries() == null ? DORIS_REQUEST_RETRIES_DEFAULT : loadConf.getRequestRetries();

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants