Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

pubsub takes too much memory #6404

Open
ec1oud opened this issue Jun 4, 2019 · 2 comments
Open

pubsub takes too much memory #6404

ec1oud opened this issue Jun 4, 2019 · 2 comments
Labels
kind/bug A bug in existing code (including security flaws) topic/perf Performance

Comments

@ec1oud
Copy link

ec1oud commented Jun 4, 2019

Version information:

go-ipfs version: 0.4.20-
Repo version: 7
System version: amd64/linux
Golang version: go1.12.4

Description:

Here's output from top after a couple of days:

  PID USER      PR  NI    VIRT    RES  %CPU  %MEM     TIME+ S COMMAND                                                                                           
28739 rutledge  20   0 9407.8m   7.1g  13.1  36.1 886:01.87 S ipfs daemon --enable-pubsub-experiment --enable-namesys-pubsub                                    

I didn't do anything out of the ordinary: not much is pinned, didn't get around to trying anything with pubsub actually. I mainly wondered if it would make ipns perform better.

@Stebalien Stebalien added kind/bug A bug in existing code (including security flaws) topic/perf Performance labels Jun 4, 2019
@Stebalien
Copy link
Member

Before you try anything else, please upgrade to 0.4.21. We fixed a bunch of performance issues in 0.4.20 that are likely related.

Then:

  1. How does this compare to not running pubsub?
  2. Are you frequently resolving IPNS records?
  3. Could you walk through https://github.com/ipfs/go-ipfs/blob/master/docs/debug-guide.md#beginning and attach the results to the issue?
  4. What's the output of ipfs swarm peers | wc -l and ipfs swarm peers --direction | grep -c outbound?
  5. What's the output of ipfs config Swarm.ConnMgr?

@ec1oud
Copy link
Author

ec1oud commented Jun 10, 2019

Hopefully 0.4.21 lands on Arch soon.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/bug A bug in existing code (including security flaws) topic/perf Performance
Projects
None yet
Development

No branches or pull requests

2 participants