Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Load uid very slowly #2276

Open
zhoujian1996 opened this issue Apr 13, 2023 · 2 comments
Open

Load uid very slowly #2276

zhoujian1996 opened this issue Apr 13, 2023 · 2 comments

Comments

@zhoujian1996
Copy link

Hi, everyOne,My project use flink handle too many kafka record. Every time, we restart the flink job, it may load too many uid from the hbase,so it makes consume the records very slowly。 SomeBody may give us some advice faster the restart process? Thanks!

@mindflying
Copy link

写入到hbase的时候,从name_cache或者id_cache dump到本地文件
重启flink的时候,直接从文件加载撒

@zhoujian1996
Copy link
Author

好的,我们按照这种方式试下。有个问题请教下:opentsdb好像无法感知到hbase端regionServer的变化导致一直向错误的regionServer导入大量流量,这种你们有遇见过吗?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants