Redis cluster will fail to insert large-scale key-values

[yingcanw]

Create a minimal Redis cluster (locally three master nodes on a single machine) completely follow the Redis tutorial. When trying to insert 1.3 billion key-values (about 576 bytes per key-value) into the redis cluster, it will crash.

Since we are simulating the redis cluster based on a single node and each virtual node has the turn on append-only mode, it may crash due to the problem of creating many incremental files in case of repeated failures and retries of an AOF rewrite. Not sure if this is a bug of Redis or an unreasonable cluster configuration.

Crash report

Paste the complete crash log between the quotes below. Please include a few lines from the log preceding the crash report to provide some context.

Additional information

1. OS distribution and version
   Ubuntu 20.04.4 LTS, two AMDEPYC 7742 CPUs, 2TB of CPU memory

[oranagra]

@yingcanw please post the crash report from the log.
since you mention incremental files, i assume you're using redis 7.0?

[xtxxtxxtx]

Would like to ask why the cluster configuration mode is so configured?
And have any other configuration patterns been tested?