RabbitMQ - Message Latency

[gerhard]

Name, email, company, job title

Name	E-mail	Company
Gerhard Lazu	gerhard@rabbitmq.com	RabbitMQ
Marcial Rosales	mrosales@pivotal.io	Pivotal

Project Title and brief description

The goal is to establish the baseline message latency for RabbitMQ

How does the open source community benefit from your work?

Our users would be able to reference the best-case scenario for message latencies. They will be able to understand the different trade-offs available, and the impact of certain choices on message latencies.

Is the code that you’re going to run 100% open source? If so, what is the URL or URLs where it is located?

Yes, 100% open-source.

This is our low-latency messaging with RabbitMQ work-in-progress.

This is the reason why our current setup is not suitable for this type of testing.

Does the infrastructure provided meet your testing needs (see: https://www.acceleratewithoptane.com/access/)?

No, it doesn't. We need at least 2 systems:

• one system for the client (PerfTest) and metrics (Prometheus & Grafana) - a c2.medium.x86 will suffice
• a separate system for the broker (RabbitMQ Server)

Both hosts need to be connected by a real network with a max network latency of 0.3ms, as measured by fping.

To benchmark a RabbitMQ cluster, we would need 4 systems:

• one system for the client (PerfTest) and metrics (Prometheus & Grafana) - a c2.medium.x86 will suffice
• three systems for three independent brokers (RabbitMQ Server) that would form a single cluster

What performance-focused articles has your project published before?

• http://www.rabbitmq.com/blog/category/performance-2/
• https://github.com/rabbitmq/workloads
• https://groups.google.com/forum/#!topic/rabbitmq-users/LSYaac9frYw

Please state your contributions to the open source community and any other relevant initiatives

RabbitMQ is the most widely deployed open source message broker.

With more than 35,000 production deployments of RabbitMQ world-wide at small startups and large enterprises, RabbitMQ is the most popular open source message broker.

https://www.rabbitmq.com/

Would you be willing to share your analysis and results publicly?

Yes

Are you interested in testing Intel Optane SSDs with Intel Memory Drive Technology (IMDT)?

Very much so. This would be a great follow-up to Help us determine better Erlang VM memory management configuration defaults for RabbitMQ.