latency

Tail Latency effects on a distributed system

Assume each microservice has 1 ms average latency, but the 99th percentile is 1s. A transaction touching just one of these services has a 1% chance to take ≥ 1s. A transaction touching 100 of these services has 1 – (1 – 0.01)*100 = 63% chance to take ≥ 1s.

• yuri-shkuro-on-observability-challenges-in-microservices-and-cloud-native-applications/

Latency

• latency-numbers-everyone-should-know
• the-story-of-one-latency-spike
• revenge-listening-sockets
• how-to-receive-a-million-packets
• how-to-achieve-low-latency
• Analysis of Linux UDP Sockets Concurrent Performance
• Intel ethernet-controllers-latency-appl-note.pdf

Performance

• kernel.org/doc/Documentation/networking/scaling.txt