Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Canal Server 解析性能问题 #547

Closed
wingerx opened this issue Mar 2, 2018 · 4 comments
Closed

Canal Server 解析性能问题 #547

wingerx opened this issue Mar 2, 2018 · 4 comments

Comments

@wingerx
Copy link
Collaborator

wingerx commented Mar 2, 2018

不知有人压测过 Canal 的解析性能吗?目前压测 v1.0.26 alpha 1 (为屏蔽可能消费慢的原因,修改代码将event 不放入store),开始大概每秒可以decode 万级别的event,但是持续一段时间后每秒下降到百级别的event (后续定位到是压测停的时候)。不知有人遇到过这个问题没?

@wingerx
Copy link
Collaborator Author

wingerx commented Mar 5, 2018

补上测试数据, (纯测试解析,因为不存store,故无消费端影响)

  1. 纯insert 场景测试
    image
  2. Canal Server 接收到数据
  • 使用 v1.0.26 版本的 SocketChannel 与 SocketChannelPool 测试情况
    image

当压测停止时,性能出现陡降(此时event 并没有同步结束):
红线标注的是关掉压测的瞬间
image

压测重新启动后,性能回升但抖动很大,持续一段时间后,性能回到停之前的状态
image
image

当压测停止时,性能出现提升(这个现象和MySQL slave 观察到的网络流量现象一致):
image

@agapple
Copy link
Member

agapple commented Mar 12, 2018

是否这么一个结论,基于BIO模式的读取,性能更加稳定?

@Wu-Jianqiang
Copy link
Contributor

Wu-Jianqiang commented Mar 12, 2018

@wingerx PR了异步修复版 #553 ,有空再试试!

@hello-llc
Copy link

能请教一下,你压测时候的统计数据是怎样获取的吗?

LieLieLiekey pushed a commit to LieLieLiekey/canal that referenced this issue May 24, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants