Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: trace memory for some data structures #1927

Closed

Conversation

yangby-cryptape
Copy link
Collaborator

@yangby-cryptape yangby-cryptape commented Feb 7, 2020

Features

Usage

This function will be enabled when compile the executable with feature measure-collections.

@yangby-cryptape yangby-cryptape requested review from a team and xxuejie February 7, 2020 00:16
@yangby-cryptape
Copy link
Collaborator Author

yangby-cryptape commented Feb 7, 2020

An example of log outpus:

2020-02-17 15:26:37.020 +00:00 MemoryTracker TRACE ckb-memory-tracker  CurrentProcess { pid: 16584, rss: 720148 KiB, virt: 5333816 KiB, Jemalloc: { allocated: 568917 KiB, resident: 673336 KiB, active: 583136 KiB, mapped: 740500 KiB, retained: 523116 KiB, metadata: 18437 KiB } }
2020-02-17 15:26:37.020 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashMap              { tag: sync-state.block-status-map             , len:   860679, cap:   916867 }
2020-02-17 15:26:37.020 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashMap              { tag: sync-state.header-map                   , len:   832333, cap:   902890 }
2020-02-17 15:26:37.020 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashMap              { tag: sync-state.inflight-blocks.blocks       , len:        1, cap:        1 }
2020-02-17 15:26:37.020 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashMap              { tag: sync-state.inflight-blocks.states       , len:        8, cap:       28 }
2020-02-17 15:26:37.020 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashSet              { tag: sync-state.inflight-proposals           , len:        0, cap:        0 }
2020-02-17 15:26:37.020 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashMap              { tag: sync-state.known-txs.inner              , len:        0, cap:        0 }
2020-02-17 15:26:37.020 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashMap              { tag: sync-state.misbehavior                  , len:        0, cap:        0 }
2020-02-17 15:26:37.020 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashMap              { tag: sync-state.orphan-block-pool.blocks     , len:        0, cap:     1792 }
2020-02-17 15:26:37.020 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashMap              { tag: sync-state.orphan-block-pool.parents    , len:        0, cap:        0 }
2020-02-17 15:26:37.020 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashMap              { tag: sync-state.peers.state                  , len:        8, cap:       14 }
2020-02-17 15:26:37.020 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashMap              { tag: sync-state.pending-compact-blocks       , len:        0, cap:        0 }
2020-02-17 15:26:37.020 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashMap              { tag: tx-pool.gap.inner.entries               , len:        0, cap:        0 }
2020-02-17 15:26:37.020 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashMap              { tag: tx-pool.gap.inner.links                 , len:        0, cap:        0 }
2020-02-17 15:26:37.020 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashMap              { tag: tx-pool.orphan.edges                    , len:        0, cap:        0 }
2020-02-17 15:26:37.020 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashMap              { tag: tx-pool.orphan.vertices                 , len:        0, cap:        0 }
2020-02-17 15:26:37.021 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashMap              { tag: tx-pool.pending.inner.entries           , len:        0, cap:        0 }
2020-02-17 15:26:37.021 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashMap              { tag: tx-pool.pending.inner.links             , len:        0, cap:        0 }
2020-02-17 15:26:37.021 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashMap              { tag: tx-pool.proposed.edges.deps             , len:        0, cap:        0 }
2020-02-17 15:26:37.021 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashMap              { tag: tx-pool.proposed.edges.inner            , len:        0, cap:        0 }
2020-02-17 15:26:37.021 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashMap              { tag: tx-pool.proposed.edges.outer            , len:        0, cap:        0 }
2020-02-17 15:26:37.021 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashMap              { tag: tx-pool.proposed.inner.entries          , len:        0, cap:        0 }
2020-02-17 15:26:37.021 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashMap              { tag: tx-pool.proposed.inner.links            , len:        0, cap:        0 }
2020-02-17 15:26:47.025 +00:00 MemoryTracker TRACE ckb-memory-tracker  CurrentProcess { pid: 16584, rss: 725692 KiB, virt: 5333816 KiB, Jemalloc: { allocated: 568934 KiB, resident: 681988 KiB, active: 583064 KiB, mapped: 749148 KiB, retained: 514468 KiB, metadata: 18440 KiB } }
2020-02-17 15:26:47.025 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashMap              { tag: sync-state.block-status-map             , len:   860494, cap:   916754 }
2020-02-17 15:26:47.025 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashMap              { tag: sync-state.header-map                   , len:   832148, cap:   902772 }
2020-02-17 15:26:47.025 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashMap              { tag: sync-state.inflight-blocks.blocks       , len:        1, cap:        1 }
2020-02-17 15:26:47.025 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashMap              { tag: sync-state.inflight-blocks.states       , len:       15, cap:       28 }
2020-02-17 15:26:47.025 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashSet              { tag: sync-state.inflight-proposals           , len:        0, cap:        0 }
2020-02-17 15:26:47.025 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashMap              { tag: sync-state.known-txs.inner              , len:        0, cap:        0 }
2020-02-17 15:26:47.025 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashMap              { tag: sync-state.misbehavior                  , len:        0, cap:        0 }
2020-02-17 15:26:47.025 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashMap              { tag: sync-state.orphan-block-pool.blocks     , len:        0, cap:     1792 }
2020-02-17 15:26:47.025 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashMap              { tag: sync-state.orphan-block-pool.parents    , len:        0, cap:        0 }
2020-02-17 15:26:47.025 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashMap              { tag: sync-state.peers.state                  , len:        8, cap:       14 }
2020-02-17 15:26:47.026 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashMap              { tag: sync-state.pending-compact-blocks       , len:        0, cap:        0 }
2020-02-17 15:26:47.026 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashMap              { tag: tx-pool.gap.inner.entries               , len:        0, cap:        0 }
2020-02-17 15:26:47.026 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashMap              { tag: tx-pool.gap.inner.links                 , len:        0, cap:        0 }
2020-02-17 15:26:47.026 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashMap              { tag: tx-pool.orphan.edges                    , len:        0, cap:        0 }
2020-02-17 15:26:47.026 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashMap              { tag: tx-pool.orphan.vertices                 , len:        0, cap:        0 }
2020-02-17 15:26:47.026 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashMap              { tag: tx-pool.pending.inner.entries           , len:        0, cap:        0 }
2020-02-17 15:26:47.026 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashMap              { tag: tx-pool.pending.inner.links             , len:        0, cap:        0 }
2020-02-17 15:26:47.026 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashMap              { tag: tx-pool.proposed.edges.deps             , len:        0, cap:        0 }
2020-02-17 15:26:47.026 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashMap              { tag: tx-pool.proposed.edges.inner            , len:        0, cap:        0 }
2020-02-17 15:26:47.026 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashMap              { tag: tx-pool.proposed.edges.outer            , len:        0, cap:        0 }
2020-02-17 15:26:47.026 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashMap              { tag: tx-pool.proposed.inner.entries          , len:        0, cap:        0 }
2020-02-17 15:26:47.026 +00:00 MemoryTracker TRACE ckb-memory-tracker  HashMap              { tag: tx-pool.proposed.inner.links            , len:        0, cap:        0 }

doitian
doitian previously approved these changes Feb 10, 2020
@yangby-cryptape yangby-cryptape requested review from doitian and a team and removed request for a team, doitian and xxuejie February 11, 2020 11:29
@yangby-cryptape yangby-cryptape changed the title feat: trace memory for some data structures and current process [HOLD] feat: trace memory for some data structures and current process Feb 11, 2020
nervos-bot[bot]
nervos-bot bot previously requested changes Feb 11, 2020
Copy link

@nervos-bot nervos-bot bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hold as requested by @yangby-cryptape.

@yangby-cryptape yangby-cryptape added the s:hold Status: Put this issue on hold. label Feb 11, 2020
@yangby-cryptape yangby-cryptape changed the title [HOLD] feat: trace memory for some data structures and current process feat: trace memory for some data structures Feb 17, 2020
@nervos-bot nervos-bot bot dismissed their stale review February 17, 2020 15:26

Unhold as requested by @yangby-cryptape.

@yangby-cryptape yangby-cryptape added s:waiting-on-reviewers Status: Waiting for Review and removed s:hold Status: Put this issue on hold. labels Feb 17, 2020
@yangby-cryptape yangby-cryptape requested a review from a team February 17, 2020 15:35
@doitian doitian changed the title feat: trace memory for some data structures [HOLD] feat: trace memory for some data structures Mar 3, 2020
nervos-bot[bot]
nervos-bot bot previously requested changes Mar 3, 2020
Copy link

@nervos-bot nervos-bot bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hold as requested by @doitian.

@doitian
Copy link
Member

doitian commented Mar 3, 2020

Hold because of waiting on #1940

@doitian doitian changed the title [HOLD] feat: trace memory for some data structures feat: trace memory for some data structures Mar 24, 2020
@nervos-bot nervos-bot bot dismissed their stale review March 24, 2020 06:46

Unhold as requested by @doitian.

@yangby-cryptape yangby-cryptape deleted the pr/trace-memory branch July 9, 2020 00:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
s:waiting-on-reviewers Status: Waiting for Review
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants