Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

版本兼容 #7

Closed
Francis-X opened this issue May 7, 2022 · 14 comments
Closed

版本兼容 #7

Francis-X opened this issue May 7, 2022 · 14 comments

Comments

@Francis-X
Copy link

好像不支持flink1.14.4版本

@jeff-zou
Copy link
Owner

jeff-zou commented May 13, 2022 via email

@jeff-zou
Copy link
Owner

jeff-zou commented May 13, 2022 via email

@Francis-X
Copy link
Author

第一次跑报错了,后面好像没有报错了,然后我自己实现了一套sink

@jeff-zou
Copy link
Owner

jeff-zou commented May 13, 2022 via email

@Francis-X
Copy link
Author

我底层用的Lettuce客户端

@Francis-X
Copy link
Author

你好,我可以咨询你一些问题吗?

@jeff-zou
Copy link
Owner

jeff-zou commented May 31, 2022 via email

@Francis-X
Copy link
Author

请问你有过flink 大窗口checkpoint 超时问题经历吗?

@jeff-zou
Copy link
Owner

jeff-zou commented May 31, 2022 via email

@Francis-X
Copy link
Author

我用1.14.4和1.15.0都会有这个问题,超时达到次数就把taskmanager搞挂了,你是如何解决这个问题的呢?

@jeff-zou
Copy link
Owner

jeff-zou commented Jun 1, 2022

是不是试了增量checkpoint也没用? 如果没试过可以试一下,之前我的状态非常大用增量也没用,后面是调整业务实现方式,绕开了checkpoint, 大致思路是将任务拆分成两个,第一个任务先预处理,第二个任务做聚合计算时只需要对简单数据进行checkpoint. 可以加我v聊 zilong954224

@Francis-X
Copy link
Author

对的,增量checkpoint也没用,我这边是因为窗口开了一个小时,数据来源频率是每10分钟会产生20多万数据

@jeff-zou
Copy link
Owner

jeff-zou commented Jun 1, 2022 via email

@jeff-zou
Copy link
Owner

close

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants