Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

weaver is using 40% CPU #1151

Closed
tomwilkie opened this issue Jul 15, 2015 · 3 comments
Closed

weaver is using 40% CPU #1151

tomwilkie opened this issue Jul 15, 2015 · 3 comments
Assignees
Labels
Milestone

Comments

@tomwilkie
Copy link
Contributor

Looks like something in the gossip code, probably dns.

@tomwilkie tomwilkie self-assigned this Jul 15, 2015
@rade rade added the bug label Jul 15, 2015
@rade rade added this to the current milestone Jul 15, 2015
@tomwilkie
Copy link
Contributor Author

Repro with the test on dns-gossip branch (210_dns_cross_host)

@tomwilkie
Copy link
Contributor Author

vagrant@host1:~$ go tool pprof http://$(docker inspect --format='{{.NetworkSettings.IPAddress}}' weave):6784/debug/pprof/profile
Fetching profile from http://172.17.0.92:6784/debug/pprof/profile
Please wait... (30s)
Saved profile in /home/vagrant/pprof/pprof.172.17.0.92:6784.samples.cpu.001.pb.gz
Entering interactive mode (type "help" for commands)
(pprof) top10 -cum
0.08s of 12.91s total ( 0.62%)
Dropped 200 nodes (cum <= 0.06s)
Showing top 10 nodes out of 114 (cum >= 3.89s)
      flat  flat%   sum%        cum   cum%
         0     0%     0%      8.15s 63.13%  runtime.goexit
         0     0%     0%      5.46s 42.29%  github.com/weaveworks/weave/router.(*LocalConnection).receiveTCP
         0     0%     0%      4.97s 38.50%  encoding/gob.(*Decoder).Decode
     0.04s  0.31%  0.31%      4.97s 38.50%  encoding/gob.(*Decoder).DecodeValue
         0     0%  0.31%      4.81s 37.26%  github.com/weaveworks/weave/router.(*LocalConnection).handleProtocolMsg
         0     0%  0.31%      4.81s 37.26%  github.com/weaveworks/weave/router.(*Router).handleGossip
         0     0%  0.31%      4.31s 33.38%  github.com/weaveworks/weave/router.(*GossipChannel).deliver
     0.03s  0.23%  0.54%      4.24s 32.84%  encoding/gob.(*Decoder).decodeValue
         0     0%  0.54%      3.89s 30.13%  github.com/weaveworks/weave/nameserver.(*Nameserver).OnGossip
     0.01s 0.077%  0.62%      3.89s 30.13%  github.com/weaveworks/weave/nameserver.(*Nameserver).receiveGossip

@tomwilkie
Copy link
Contributor Author

Looks like its definitely the new gossipdns, and come kind of non-converging gossip.

rade added a commit that referenced this issue Jul 15, 2015
Make DNS gossip converge correctly

Fixes #1151
@rade rade modified the milestones: current, 1.1.0 Jul 21, 2015
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants