Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tendis 单实例部署 RSS内存占用过高问题 #250

Open
chenshi2023 opened this issue Oct 11, 2023 · 2 comments
Open

Tendis 单实例部署 RSS内存占用过高问题 #250

chenshi2023 opened this issue Oct 11, 2023 · 2 comments

Comments

@chenshi2023
Copy link

Description

Tendis 单实例 total-memory 内存开销 7g左右,但实际进程的 RSS内存开销不断增大 涨到48.8G,
想了解下除了rocksdb自身内存消耗, RSS内存其他消耗在哪些地方?

  • 资源消耗:

rocksdb.total-memory:7067943720
rocksdb.size-all-mem-tables:2759316280
rocksdb.estimate-table-readers-mem:18733136
rocksdb.blockcache.capacity:4294967296

memory-2

  • tendis实例指标信息
Dataset
rocksdb.kvstore-count:10
rocksdb.total-sst-files-size:7378251993
rocksdb.binlogcf-sst-files-size:501995550
rocksdb.live-sst-files-size:7378251993
rocksdb.estimate-live-data-size:2287508414
rocksdb.estimate-num-keys:261300
rocksdb.estimate-num-keys-binlogcf:52956
rocksdb.total-memory:7067943720
rocksdb.cur-size-all-mem-tables:734126328
rocksdb.size-all-mem-tables:2759316280
rocksdb.estimate-table-readers-mem:18733136
rocksdb.blockcache.capacity:4294967296
rocksdb.blockcache.usage:4289894304
rocksdb.blockcache.pinnedusage:918304
rocksdb.mem-table-flush-pending:0
rocksdb.estimate-pending-compaction-bytes:0
rocksdb.compaction-pending:0
rocksdb.number.iter.skip:5969504
rocksdb.compaction-filter-count:12800390
rocksdb.compaction-kv-expired-count:0
  • tendis实例进程RSS开销增长情况:

memory-3

  • tendis实例进程线程运行情况:

memory-1

Expected Behavior

Current Behavior

Possible Solution

Steps to Reproduce (for bugs)

Context

Your Environment

  • Operating System and version:
  • Machine Specifications:
  • Tendis Version:
  • Tendis Configuration:
  • IO/Network used:
  • Link to your project:
@githubname1024
Copy link

@takenliu
我也遇到了同样的问题,tendis实例的RSS内存占用一直在增长。
设置了rocks.cache_index_and_filter_blocks=1,RSS内存也一直增长。
后边对比了官网的Requirements,发现要求g++版本大于等于5.5。而我使用的默认centos7.5自带的g++ 为4.8.5。
升级机器gcc版本之后,发现内存占用维持在一定范围以下(如我的配置下为12G)。
想确认一下,这个RSS内存增长是不是和gcc版本有关?
谢谢。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants