Skip to content

Conversation

@bhapas
Copy link
Contributor

@bhapas bhapas commented Jan 4, 2024

Support system benchmarking with the logstash-output in the benchmarking agent policies.

If stack.logstash_enabled: true is set in the current profile's config use the logstash output over the default.

@bhapas bhapas self-assigned this Jan 4, 2024
@bhapas bhapas requested review from jsoriano and mrodm January 4, 2024 14:32

// Assign the data_output_id to the agent policy to configure the output to logstash. The value is inferred from stack/_static/kibana.yml.tmpl
if r.options.Profile.Config("stack.logstash_enabled", "false") == "true" {
p.DataOutputID = "fleet-logstash-output"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could we add a test for this case?

Copy link
Contributor Author

@bhapas bhapas Jan 8, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@jsoriano You mean a test package? The test-check-packages has regular benchmarks being tested. Should we add another package like benchmarks-with-logstash?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It would be a test that runs benchmarks with logstash, it can be a new package or a new script and an existing package, not sure what would be the best approach.

Copy link
Contributor Author

@bhapas bhapas Jan 8, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I can add a regression test. As currently logstash does not provide relevant stats that are comparable to ingest node stats. But I just want to make sure we can run system benchmarks even with logstash enabled.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@jsoriano Added a test package

@bhapas bhapas force-pushed the logstash-benchmark branch 2 times, most recently from 983edad to 57f0264 Compare January 9, 2024 08:47
@bhapas bhapas force-pushed the logstash-benchmark branch from 57f0264 to 9aef4d8 Compare January 9, 2024 09:09
@elasticmachine
Copy link
Collaborator

💚 Build Succeeded

History

cc @bhapas

Copy link
Member

@jsoriano jsoriano left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for adding a test case!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants