Skip to content
This repository has been archived by the owner on Sep 21, 2023. It is now read-only.

Performance test the shipper Kafka output #232

Open
Tracked by #116 ...
cmacknz opened this issue Jan 26, 2023 · 0 comments
Open
Tracked by #116 ...

Performance test the shipper Kafka output #232

cmacknz opened this issue Jan 26, 2023 · 0 comments
Labels
Team:Elastic-Agent Label for the Agent team

Comments

@cmacknz
Copy link
Member

cmacknz commented Jan 26, 2023

Prior to considering the Kafka output available for beta use we should conduct some performance tests against a self-hosted or managed Kafka instance.

The initial goal of these tests is not to discover the optimal output configuration for publishing events to Kafka, but to perform an end to end test against a real Kafka instance and ensure that there are no obvious performance problems (e.g. throughput 25% as good as Elasticsearch without an obvious explanation).

We can base these tests off of the performance tests currently being designed with the Elasticsearch output using Filebeat as the shipper data source.

@cmacknz cmacknz added the Team:Elastic-Agent Label for the Agent team label Jan 26, 2023
@cmacknz cmacknz changed the title Performance test the shipper when used the Kafka output Performance test the shipper Kafka output Jan 26, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Team:Elastic-Agent Label for the Agent team
Projects
None yet
Development

No branches or pull requests

1 participant