Join GitHub today
GitHub is home to over 28 million developers working together to host and review code, manage projects, and build software together.
Sign upredis-3.0.6 crash #3079
Comments
This comment has been minimized.
Show comment
Hide comment
This comment has been minimized.
antirez
Feb 10, 2016
Owner
Hello, please use a 32 bit build otherwise memory cannot be used. Apparently in certain configurations Linux will refuse to provide more memory to 32 bit processes once they reach ~ 1GB. In order to have more info, please send us the line immediately before the crash, it contains informations about the failed allocation.
|
Hello, please use a 32 bit build otherwise memory cannot be used. Apparently in certain configurations Linux will refuse to provide more memory to 32 bit processes once they reach ~ 1GB. In order to have more info, please send us the line immediately before the crash, it contains informations about the failed allocation. |
This comment has been minimized.
Show comment
Hide comment
This comment has been minimized.
antirez
Feb 10, 2016
Owner
Hint, maybe there is something limiting the 32 bit processes to 1GB via rlimit using either chroups or namespaces?
|
Hint, maybe there is something limiting the 32 bit processes to 1GB via rlimit using either chroups or namespaces? |
This comment has been minimized.
Show comment
Hide comment
This comment has been minimized.
stefantalpalaru
Feb 10, 2016
Here are the lines before the crash:
26280:M 10 Feb 10:32:54.046 * 10 changes in 300 seconds. Saving...
26280:M 10 Feb 10:32:54.093 * Background saving started by pid 23187
23187:C 10 Feb 10:33:06.780 * DB saved on disk
23187:C 10 Feb 10:33:06.829 * RDB: 37 MB of memory used by copy-on-write
26280:M 10 Feb 10:33:06.935 * Background saving terminated with success
26280:M 10 Feb 10:37:04.207 # Out Of Memory allocating 18756735 bytes!
26280:M 10 Feb 10:37:04.208 #
I reduced maxmemory to 512MiB as a workaround.
Changing the userspace from 32bit to 64bit is not straightforward, since an in-place upgrade is not possible, so I'd have to build another VPS image and move my files and setup there. Too much billable work to justify to the client.
stefantalpalaru
commented
Feb 10, 2016
|
Here are the lines before the crash: 26280:M 10 Feb 10:32:54.046 * 10 changes in 300 seconds. Saving... I reduced maxmemory to 512MiB as a workaround. Changing the userspace from 32bit to 64bit is not straightforward, since an in-place upgrade is not possible, so I'd have to build another VPS image and move my files and setup there. Too much billable work to justify to the client. |
This comment has been minimized.
Show comment
Hide comment
This comment has been minimized.
antirez
Feb 10, 2016
Owner
Makes sense, you are not the first to report that 32 bit processes are capped to 1GB, I would love to discover what the heck it is. Thanks.
|
Makes sense, you are not the first to report that 32 bit processes are capped to 1GB, I would love to discover what the heck it is. Thanks. |
This comment has been minimized.
Show comment
Hide comment
This comment has been minimized.
stefantalpalaru
Feb 23, 2016
Looks like it's a memory fragmentation problem. Here are my findings so far:
- command to test the stability (make sure that maxmemory-policy is allkeys-lru):
while true; do redis-benchmark -q -t set -r 4000 -n 4000 -d 1048576 || break; redis-benchmark -q -t set -r 4000000 -n 4000000 -d 1024 || break; done- jemalloc-4.0.4 - stable with maxmemory at (the equivalent of) 800MiB, crashes at 900MiB
- libc malloc (glibc-2.22) - stable with maxmemory at 1GiB, crashes at 1.1GiB
- tcmalloc-2.0 - stable with maxmemory at 1.4GiB, crashes at 1.5GiB
The mem_fragmentation_ratio during a crash varies from one allocator to another (1.78 with libc, 1.71 with jemalloc, 1.97 with tcmalloc), so I'm thinking that the virtual memory fragmentation is not showing in the RSS because it's at a higher level.
On the same system, a simple test program is able to allocate 30 chunks of 100 MiB before getting a NULL pointer from malloc() with glibc, 26 chunks with jemalloc and 29 chunks with tcmalloc. So it's not an OS limitation on the total memory size for one program.
stefantalpalaru
commented
Feb 23, 2016
|
Looks like it's a memory fragmentation problem. Here are my findings so far:
while true; do redis-benchmark -q -t set -r 4000 -n 4000 -d 1048576 || break; redis-benchmark -q -t set -r 4000000 -n 4000000 -d 1024 || break; done
The mem_fragmentation_ratio during a crash varies from one allocator to another (1.78 with libc, 1.71 with jemalloc, 1.97 with tcmalloc), so I'm thinking that the virtual memory fragmentation is not showing in the RSS because it's at a higher level. On the same system, a simple test program is able to allocate 30 chunks of 100 MiB before getting a NULL pointer from malloc() with glibc, 26 chunks with jemalloc and 29 chunks with tcmalloc. So it's not an OS limitation on the total memory size for one program. |
This comment has been minimized.
Show comment
Hide comment
This comment has been minimized.
gonguinguen
May 14, 2018
Hi there. I'm having the same issue with a 32 bit version of Redis 3.0.6
I'm using maxmemory 2gb and maxmemory-policy allkeys-lru
The server has plenty of RAM available (all processes together use around 15gb of RAM, and the server has 48gb total). I'm running Ubuntu 14.04.
This is the Redis crash log in case it helps:
3874:M 10 May 01:20:05.629 * Redis 3.0.6 (00000000/0) 32 bit, standalone mode, port 6379, pid 3874 ready to start.
3874:M 10 May 01:20:05.629 # Server started, Redis version 3.0.6
3874:M 10 May 01:20:05.683 * DB loaded from disk: 0.054 seconds
3874:M 10 May 01:20:05.684 * The server is now ready to accept connections on port 6379
3874:M 12 May 23:59:48.141 # Out Of Memory allocating 1692757 bytes!
3874:M 12 May 23:59:48.141 #
=== REDIS BUG REPORT START: Cut & paste starting from here ===
3874:M 12 May 23:59:48.141 # ------------------------------------------------
3874:M 12 May 23:59:48.141 # !!! Software Failure. Press left mouse button to continue
3874:M 12 May 23:59:48.141 # Guru Meditation: "Redis aborting for OUT OF MEMORY" #redis.c:3572
3874:M 12 May 23:59:48.141 # (forcing SIGSEGV in order to print the stack trace)
3874:M 12 May 23:59:48.142 # ------------------------------------------------
3874:M 12 May 23:59:48.142 # Redis 3.0.6 crashed by signal: 11
3874:M 12 May 23:59:48.142 # SIGSEGV caused by address: 0xffffffff
3874:M 12 May 23:59:48.142 # Failed assertion: (:0)
3874:M 12 May 23:59:48.143 # --- STACK TRACE
/usr/bin/redis-server *:6379(logStackTrace+0x45)[0x809b215]
/usr/bin/redis-server *:6379(_redisPanic+0x84)[0x8099e44]
[0xf7f85cc0]
/usr/bin/redis-server *:6379(_redisPanic+0x84)[0x8099e44]
/usr/bin/redis-server *:6379(redisOutOfMemoryHandler+0x3b)[0x8061c3b]
/usr/bin/redis-server *:6379(zrealloc+0xe1)[0x806a601]
/usr/bin/redis-server *:6379(sdsMakeRoomFor+0x41)[0x8068fb1]
/usr/bin/redis-server *:6379(processMultibulkBuffer+0x292)[0x8070882]
/usr/bin/redis-server *:6379(processInputBuffer+0x82)[0x8071cb2]
/usr/bin/redis-server *:6379(readQueryFromClient+0xbf)[0x8071dcf]
/usr/bin/redis-server *:6379(aeProcessEvents+0x140)[0x805e6b0]
/usr/bin/redis-server *:6379(aeMain+0x2c)[0x805ea0c]
/usr/bin/redis-server *:6379(main+0x371)[0x805d711]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf7d7faf3]
/usr/bin/redis-server *:6379[0x805d925]
3874:M 12 May 23:59:48.145 # --- INFO OUTPUT
3874:M 12 May 23:59:48.146 # # Server
redis_version:3.0.6
redis_git_sha1:00000000
redis_git_dirty:0
redis_build_id:315c8c74805fca88
redis_mode:standalone
os:Linux 4.15.13-x86_64-linode106 x86_64
arch_bits:32
multiplexing_api:epoll
gcc_version:4.6.3
process_id:3874
run_id:37f8026db62db61187d19f6cb1634b92990e0850
tcp_port:6379
uptime_in_seconds:254383
uptime_in_days:2
hz:10
lru_clock:16230948
config_file:/etc/redis/redis.conf
Clients
connected_clients:3494
client_longest_output_list:0
client_biggest_input_buf:0
blocked_clients:0
Memory
used_memory:2126798552
used_memory_human:1.98G
used_memory_rss:2279911424
used_memory_peak:2147596848
used_memory_peak_human:2.00G
used_memory_lua:26624
mem_fragmentation_ratio:1.07
mem_allocator:jemalloc-3.6.0
Persistence
loading:0
rdb_changes_since_last_save:34572318
rdb_bgsave_in_progress:0
rdb_last_save_time:1525926005
rdb_last_bgsave_status:ok
rdb_last_bgsave_time_sec:-1
rdb_current_bgsave_time_sec:-1
aof_enabled:0
aof_rewrite_in_progress:0
aof_rewrite_scheduled:0
aof_last_rewrite_time_sec:-1
aof_current_rewrite_time_sec:-1
aof_last_bgrewrite_status:ok
aof_last_write_status:ok
Stats
total_connections_received:1430428
total_commands_processed:227688401
instantaneous_ops_per_sec:931
total_net_input_bytes:370209425042
total_net_output_bytes:627664125593
instantaneous_input_kbps:940.69
instantaneous_output_kbps:2772.66
rejected_connections:0
sync_full:0
sync_partial_ok:0
sync_partial_err:0
expired_keys:3582088
evicted_keys:1673072
keyspace_hits:186445071
keyspace_misses:6195683
pubsub_channels:0
pubsub_patterns:0
latest_fork_usec:0
migrate_cached_sockets:0
Replication
role:master
connected_slaves:0
master_repl_offset:0
repl_backlog_active:0
repl_backlog_size:1048576
repl_backlog_first_byte_offset:0
repl_backlog_histlen:0
CPU
used_cpu_sys:7081.34
used_cpu_user:4041.40
used_cpu_sys_children:0.00
used_cpu_user_children:0.00
Commandstats
cmdstat_get:calls=92711047,usec=703708857,usec_per_call=7.59
cmdstat_setnx:calls=3240070,usec=24320685,usec_per_call=7.51
cmdstat_setex:calls=6419642,usec=101657757,usec_per_call=15.84
cmdstat_del:calls=3240498,usec=20980007,usec_per_call=6.47
cmdstat_exists:calls=460699,usec=3825779,usec_per_call=8.30
cmdstat_sadd:calls=8480629,usec=52890581,usec_per_call=6.24
cmdstat_srem:calls=2527,usec=8915,usec_per_call=3.53
cmdstat_sunion:calls=1854,usec=4131945,usec_per_call=2228.67
cmdstat_smembers:calls=1891,usec=2956077,usec_per_call=1563.23
cmdstat_hmset:calls=2519135,usec=36701508,usec_per_call=14.57
cmdstat_hgetall:calls=1893141,usec=29255072,usec_per_call=15.45
cmdstat_incrby:calls=2060987,usec=20709161,usec_per_call=10.05
cmdstat_expire:calls=2519135,usec=9404029,usec_per_call=3.73
cmdstat_expireat:calls=3209821,usec=8011537,usec_per_call=2.50
cmdstat_ping:calls=848,usec=2035,usec_per_call=2.40
cmdstat_multi:calls=5729347,usec=14449340,usec_per_call=2.52
cmdstat_exec:calls=5729347,usec=189824583,usec_per_call=33.13
cmdstat_flushall:calls=3,usec=2952,usec_per_call=984.00
cmdstat_info:calls=8,usec=5464,usec_per_call=683.00
cmdstat_ttl:calls=89467756,usec=402774537,usec_per_call=4.50
cmdstat_dump:calls=6,usec=827,usec_per_call=137.83
cmdstat_script:calls=10,usec=191,usec_per_call=19.10
Cluster
cluster_enabled:0
Keyspace
db0:keys=425554,expires=424758,avg_ttl=233979279
hash_init_value: 1526447768
3874:M 12 May 23:59:48.146 # --- CLIENT LIST OUTPUT
3874:M 12 May 23:59:48.146 # Out Of Memory allocating 1397609 bytes!
3874:M 12 May 23:59:48.146 # ------------------------------------------------
3874:M 12 May 23:59:48.146 # !!! Software Failure. Press left mouse button to continue
3874:M 12 May 23:59:48.147 # Guru Meditation: "Redis aborting for OUT OF MEMORY" #redis.c:3572
3874:M 12 May 23:59:48.147 # (forcing SIGSEGV in order to print the stack trace)
3874:M 12 May 23:59:48.147 # ------------------------------------------------
3687:M 13 May 00:06:28.681 * Redis 3.0.6 (00000000/0) 32 bit, standalone mode, port 6379, pid 3687 ready to start.
3687:M 13 May 00:06:28.682 # Server started, Redis version 3.0.6
3687:M 13 May 00:06:28.725 * DB loaded from disk: 0.043 seconds
3687:M 13 May 00:06:28.725 * The server is now ready to accept connections on port 6379
gonguinguen
commented
May 14, 2018
|
Hi there. I'm having the same issue with a 32 bit version of Redis 3.0.6 This is the Redis crash log in case it helps: 3874:M 10 May 01:20:05.629 * Redis 3.0.6 (00000000/0) 32 bit, standalone mode, port 6379, pid 3874 ready to start. === REDIS BUG REPORT START: Cut & paste starting from here === Clientsconnected_clients:3494 Memoryused_memory:2126798552 Persistenceloading:0 Statstotal_connections_received:1430428 Replicationrole:master CPUused_cpu_sys:7081.34 Commandstatscmdstat_get:calls=92711047,usec=703708857,usec_per_call=7.59 Clustercluster_enabled:0 Keyspacedb0:keys=425554,expires=424758,avg_ttl=233979279 3874:M 12 May 23:59:48.146 # --- CLIENT LIST OUTPUT |
This comment has been minimized.
Show comment
Hide comment
This comment has been minimized.
gonguinguen
Jun 3, 2018
In case someone else is dealing with this issue, I confirm that the problem was solved after upgrading Redis to a newer version. I was using an old 32bit version, and I moved to the latest 64bit stable version. Since there, Redis has been running for weeks without any issue.
gonguinguen
commented
Jun 3, 2018
|
In case someone else is dealing with this issue, I confirm that the problem was solved after upgrading Redis to a newer version. I was using an old 32bit version, and I moved to the latest 64bit stable version. Since there, Redis has been running for weeks without any issue. |
stefantalpalaru commentedFeb 10, 2016
=== REDIS BUG REPORT START: Cut & paste starting from here ===
26280:M 10 Feb 10:37:04.208 # ------------------------------------------------
26280:M 10 Feb 10:37:04.208 # !!! Software Failure. Press left mouse button to continue
26280:M 10 Feb 10:37:04.208 # Guru Meditation: "Redis aborting for OUT OF MEMORY" #redis.c:3572
26280:M 10 Feb 10:37:04.208 # (forcing SIGSEGV in order to print the stack trace)
26280:M 10 Feb 10:37:04.208 # ------------------------------------------------
26280:M 10 Feb 10:37:04.208 # Redis 3.0.6 crashed by signal: 11
26280:M 10 Feb 10:37:04.208 # SIGSEGV caused by address: 0xffffffff
26280:M 10 Feb 10:37:04.208 # Failed assertion: (:0)
26280:M 10 Feb 10:37:04.208 # --- STACK TRACE
/usr/sbin/redis-server 127.0.0.1:6379(sigsegvHandler+0x27f)[0x80b863f]
/usr/sbin/redis-server 127.0.0.1:6379(_redisPanic+0x7c)[0x80b652c]
/usr/sbin/redis-server 127.0.0.1:6379(_redisPanic+0x7c)[0x80b652c]
/usr/sbin/redis-server 127.0.0.1:6379(redisOutOfMemoryHandler+0x2a)[0x806086a]
/usr/sbin/redis-server 127.0.0.1:6379(zrealloc+0xe2)[0x806b062]
/usr/sbin/redis-server 127.0.0.1:6379(sdsMakeRoomFor+0x39)[0x8068e79]
/usr/sbin/redis-server 127.0.0.1:6379(processMultibulkBuffer+0x2d9)[0x8079829]
/usr/sbin/redis-server 127.0.0.1:6379(processInputBuffer+0xfb)[0x8079ccb]
/usr/sbin/redis-server 127.0.0.1:6379(readQueryFromClient+0xaf)[0x8079f2f]
/usr/sbin/redis-server 127.0.0.1:6379(aeMain+0x15b)[0x805b75b]
/usr/sbin/redis-server 127.0.0.1:6379(main+0x2a0)[0x805a0e0]
/lib/libc.so.6(__libc_start_main+0xde)[0xf74e847e]
/usr/sbin/redis-server 127.0.0.1:6379[0x805a31c]
26280:M 10 Feb 10:37:04.213 # --- INFO OUTPUT
26280:M 10 Feb 10:37:04.213 # # Server
redis_version:3.0.6
redis_git_sha1:00000000
redis_git_dirty:0
redis_build_id:b5ed279f8e9c7b4b
redis_mode:standalone
os:Linux 4.1.5-x86_64-linode61 x86_64
arch_bits:32
multiplexing_api:epoll
gcc_version:4.9.3
process_id:26280
run_id:3ad903ad08c3fa4a78eabe2c0e396e1491e0c350
tcp_port:6379
uptime_in_seconds:1058916
uptime_in_days:12
hz:10
lru_clock:12231248
config_file:/etc/redis.conf
Clients
connected_clients:27
client_longest_output_list:0
client_biggest_input_buf:0
blocked_clients:1
Memory
used_memory:1073742376
used_memory_human:1.00G
used_memory_rss:1307348992
used_memory_peak:1079617984
used_memory_peak_human:1.01G
used_memory_lua:24576
mem_fragmentation_ratio:1.22
mem_allocator:jemalloc-4.0.4
Persistence
loading:0
rdb_changes_since_last_save:7134
rdb_bgsave_in_progress:0
rdb_last_save_time:1455071586
rdb_last_bgsave_status:ok
rdb_last_bgsave_time_sec:12
rdb_current_bgsave_time_sec:-1
aof_enabled:0
aof_rewrite_in_progress:0
aof_rewrite_scheduled:0
aof_last_rewrite_time_sec:-1
aof_current_rewrite_time_sec:-1
aof_last_bgrewrite_status:ok
aof_last_write_status:ok
Stats
total_connections_received:76021
total_commands_processed:1053686615
instantaneous_ops_per_sec:717
total_net_input_bytes:187819062265
total_net_output_bytes:5448135092003
instantaneous_input_kbps:5365.51
instantaneous_output_kbps:21957.26
rejected_connections:0
sync_full:0
sync_partial_ok:0
sync_partial_err:0
expired_keys:8034274
evicted_keys:9071217
keyspace_hits:2385748075
keyspace_misses:17091516
pubsub_channels:0
pubsub_patterns:2
latest_fork_usec:46642
migrate_cached_sockets:0
Replication
role:master
connected_slaves:0
master_repl_offset:0
repl_backlog_active:0
repl_backlog_size:1048576
repl_backlog_first_byte_offset:0
repl_backlog_histlen:0
CPU
used_cpu_sys:41329.66
used_cpu_user:31903.14
used_cpu_sys_children:3678.28
used_cpu_user_children:43739.08
Commandstats
cmdstat_get:calls=254390855,usec=2353049524,usec_per_call=9.25
cmdstat_set:calls=38357339,usec=466500378,usec_per_call=12.16
cmdstat_setnx:calls=12476,usec=127227,usec_per_call=10.20
cmdstat_setex:calls=3928,usec=43506,usec_per_call=11.08
cmdstat_del:calls=66597,usec=400783,usec_per_call=6.02
cmdstat_exists:calls=628,usec=3365,usec_per_call=5.36
cmdstat_mget:calls=759004480,usec=8828318748,usec_per_call=11.63
cmdstat_lpush:calls=5724,usec=71236,usec_per_call=12.45
cmdstat_rpop:calls=1079,usec=14279,usec_per_call=13.23
cmdstat_brpop:calls=881187,usec=15004018,usec_per_call=17.03
cmdstat_llen:calls=116684,usec=214333,usec_per_call=1.84
cmdstat_sadd:calls=2013,usec=20601,usec_per_call=10.23
cmdstat_srem:calls=1924,usec=20157,usec_per_call=10.48
cmdstat_smembers:calls=27179,usec=215190,usec_per_call=7.92
cmdstat_zadd:calls=3928,usec=95240,usec_per_call=24.25
cmdstat_zrem:calls=3928,usec=33927,usec_per_call=8.64
cmdstat_zrevrangebyscore:calls=12476,usec=152973,usec_per_call=12.26
cmdstat_hset:calls=3928,usec=22381,usec_per_call=5.70
cmdstat_hdel:calls=3928,usec=23750,usec_per_call=6.05
cmdstat_select:calls=76021,usec=311534,usec_per_call=4.10
cmdstat_expire:calls=12476,usec=135559,usec_per_call=10.87
cmdstat_multi:calls=55345,usec=135671,usec_per_call=2.45
cmdstat_exec:calls=55345,usec=956892,usec_per_call=17.29
cmdstat_info:calls=27341,usec=2423530,usec_per_call=88.64
cmdstat_unsubscribe:calls=64,usec=269,usec_per_call=4.20
cmdstat_psubscribe:calls=66,usec=302,usec_per_call=4.58
cmdstat_publish:calls=534724,usec=7601604,usec_per_call=14.22
cmdstat_watch:calls=12476,usec=112832,usec_per_call=9.04
cmdstat_unwatch:calls=12476,usec=28895,usec_per_call=2.32
Cluster
cluster_enabled:0
Keyspace
db2:keys=1105450,expires=829877,avg_ttl=2225453521
hash_init_value: 1454363806
26280:M 10 Feb 10:37:04.213 # --- CLIENT LIST OUTPUT
26280:M 10 Feb 10:37:04.213 # id=75747 addr=127.0.0.1:56923 fd=22 name= age=10016 idle=1 flags=N db=3 sub=0 psub=1 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=psubscribe
id=75748 addr=127.0.0.1:56924 fd=23 name= age=10016 idle=423 flags=N db=3 sub=0 psub=1 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=psubscribe
id=72665 addr=127.0.0.1:39228 fd=15 name= age=98188 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get
id=72670 addr=127.0.0.1:39253 fd=28 name= age=98186 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=mget
id=72672 addr=127.0.0.1:39296 fd=30 name= age=98184 idle=98183 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=75743 addr=127.0.0.1:56913 fd=18 name= age=10016 idle=10016 flags=N db=3 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=75744 addr=127.0.0.1:56914 fd=19 name= age=10016 idle=10016 flags=N db=3 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=sadd
id=72668 addr=127.0.0.1:39236 fd=26 name= age=98187 idle=1 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=72669 addr=127.0.0.1:39240 fd=27 name= age=98187 idle=1 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=72664 addr=127.0.0.1:39144 fd=14 name= age=98195 idle=98189 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=72673 addr=127.0.0.1:39301 fd=31 name= age=98183 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get
id=72663 addr=127.0.0.1:39140 fd=13 name= age=98196 idle=98189 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=72658 addr=127.0.0.1:39135 fd=5 name= age=98196 idle=98189 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=72659 addr=127.0.0.1:39136 fd=6 name= age=98196 idle=98189 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=72660 addr=127.0.0.1:39137 fd=7 name= age=98196 idle=98189 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=75738 addr=127.0.0.1:56878 fd=9 name= age=10017 idle=10017 flags=N db=3 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=75739 addr=127.0.0.1:56879 fd=10 name= age=10017 idle=26 flags=N db=3 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=unwatch
id=75740 addr=127.0.0.1:56880 fd=12 name= age=10017 idle=10017 flags=N db=3 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=75741 addr=127.0.0.1:56881 fd=16 name= age=10017 idle=1 flags=N db=3 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=publish
id=75742 addr=127.0.0.1:56882 fd=17 name= age=10017 idle=1 flags=b db=3 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=brpop
id=72667 addr=127.0.0.1:39234 fd=25 name= age=98188 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=mget
id=72661 addr=127.0.0.1:39138 fd=8 name= age=98196 idle=98189 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=72662 addr=127.0.0.1:39139 fd=11 name= age=98196 idle=98189 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=72666 addr=127.0.0.1:39232 fd=24 name= age=98188 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=mget
id=72671 addr=127.0.0.1:39256 fd=29 name= age=98186 idle=1 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=mget
id=75745 addr=127.0.0.1:56920 fd=20 name= age=10016 idle=10016 flags=N db=3 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=info
id=75746 addr=127.0.0.1:56922 fd=21 name= age=10016 idle=423 flags=N db=3 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=lpush
26280:M 10 Feb 10:37:04.213 # --- CURRENT CLIENT INFO
26280:M 10 Feb 10:37:04.213 # client: id=72670 addr=127.0.0.1:39253 fd=28 name= age=98186 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=mget
26280:M 10 Feb 10:37:04.213 # argv[0]: 'SET'
26280:M 10 Feb 10:37:04.213 # argv[1]: ':1:49aa57435bb84ea08af46968447ffed56b5d440d'
26280:M 10 Feb 10:37:04.213 # argv[2]: '��GAÕ®¨��
�]q�(]q�((M(�K4M))XÞ'
26280:M 10 Feb 10:37:04.213 # key ':1:49aa57435bb84ea08af46968447ffed56b5d440d' found in DB containing the following object:
26280:M 10 Feb 10:37:04.213 # Object type: 0
26280:M 10 Feb 10:37:04.213 # Object encoding: 0
26280:M 10 Feb 10:37:04.213 # Object refcount: 1
26280:M 10 Feb 10:37:04.213 # Object raw string len: 17487828
26280:M 10 Feb 10:37:04.213 # --- REGISTERS
26280:M 10 Feb 10:37:04.213 #
EAX:00000000 EBX:00000000 ECX:f700d790 EDX:00000000
EDI:011e347f ESI:00000010 EBP:fffffffe ESP:ffde75d0
SS :0000002b EFL:ffde75d0 EIP:080b652c CS:00000023
DS :0000002b ES :0000002b FS :00000000 GS:00000063
26280:M 10 Feb 10:37:04.213 # (ffde75df) -> 0806b062
26280:M 10 Feb 10:37:04.213 # (ffde75de) -> fffffffe
26280:M 10 Feb 10:37:04.213 # (ffde75dd) -> 011e347f
26280:M 10 Feb 10:37:04.213 # (ffde75dc) -> 00000010
26280:M 10 Feb 10:37:04.213 # (ffde75db) -> dd51f360
26280:M 10 Feb 10:37:04.213 # (ffde75da) -> 00000df4
26280:M 10 Feb 10:37:04.213 # (ffde75d9) -> 080fc921
26280:M 10 Feb 10:37:04.213 # (ffde75d8) -> 080ebd40
26280:M 10 Feb 10:37:04.213 # (ffde75d7) -> 0806086a
26280:M 10 Feb 10:37:04.213 # (ffde75d6) -> fffffffe
26280:M 10 Feb 10:37:04.213 # (ffde75d5) -> 011e347f
26280:M 10 Feb 10:37:04.214 # (ffde75d4) -> 00000010
26280:M 10 Feb 10:37:04.214 # (ffde75d3) -> 00000000
26280:M 10 Feb 10:37:04.214 # (ffde75d2) -> f76951b5
26280:M 10 Feb 10:37:04.214 # (ffde75d1) -> 080f3fb8
26280:M 10 Feb 10:37:04.214 # (ffde75d0) -> 00000003
26280:M 10 Feb 10:37:04.214 # --- FAST MEMORY TEST
26280:M 10 Feb 10:37:04.214 # Bio thread for job type #0 terminated
26280:M 10 Feb 10:37:04.214 # Bio thread for job type #1 terminated
26280:M 10 Feb 10:38:01.899 # Fast memory test PASSED, however your memory can still be broken. Please run a memory test for several hours if possible.
26280:M 10 Feb 10:38:01.899 #
=== REDIS BUG REPORT END. Make sure to include from START to END. ===
This is on a system with plenty of RAM:
root# free total used free shared buff/cache available Mem: 16430836 3224624 1639260 1143324 11566952 11923716 Swap: 262140 500 261640