Intermittent master-slave switching in etcd cluster

[smallemployees]

What would you like to be added?

How can I investigate the root cause when the system load and disk IO are relatively small

Why is this needed?

leader failed to send heartbeat on time: took too long, leader is overloaded likely from slow disk

[jmhbnz]

Hey @smallemployees - Thanks for your question, please refer to our FAQ for details on the error message https://etcd.io/docs/v3.4/faq/#what-does-the-etcd-warning-failed-to-send-out-heartbeat-on-time-mean

If disk metrics and system load during these errors is not an issue a slow network could also be causing it.

If you still need assistance pinpointing the root cause of the issue please provide detailed logging, monitoring & metrics so we can assist.