New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

同步到目标库的队列满了情况下，也不阻塞其他数据表同步 #39

Closed

jc3wish opened this issue Jan 10, 2020 · 1 comment

Labels

Member

jc3wish commented Jan 10, 2020

Bifrost 每个表的每一个目标库同步都是相互独立的，都各自有一个队列，这个队列大小可以通过 toserver_queue_size 来配置

但是每个队列是保存在内存中的，假如一个表设置了同时配置到3个目标库

在3个目标库中同步有，一个目标库出现异常了，一直同步失败，那队列满了的情况下，会影响其他目标库也同步不了

这里需要在这种队列满了的情况下，将新数据到磁盘队列中去，做到真正不阻塞的方式同步

这里要考滤到解析很快，所有的同步都慢的情况下，这里就没必要刷到磁盘了，还不如阻塞在那里，所以这里，应该提供在线设置，某一个同步，是否启用磁盘队列

jc3wish added the enhancement label

Member Author

jc3wish commented Jun 2, 2020

v1.2.1 版本已经支持文件队列, 可以通过配置关闭文件队列启动,

jc3wish closed this as completed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment