Skip to content

Conversation

vishaangelova
Copy link
Contributor

@vishaangelova vishaangelova commented Sep 19, 2025

This PR extends the Topics settings section of the Kafka output docs for both standalone and Fleet-managed Elastic Agents, and:

  • adds missing information about setting dynamic topics in the Kafka output doc for standalone Elastic Agents,
  • adds additional information and an example for using the add_fields processor for setting complex, dynamic topic value in both docs,
  • fixes a typo and a link text.

Resolves elastic/ingest-docs#1780

Preview

reference/fleet/kafka-output-settings.md
reference/fleet/kafka-output.md

@vishaangelova vishaangelova marked this pull request as ready for review September 19, 2025 13:39
@vishaangelova vishaangelova requested a review from a team as a code owner September 19, 2025 13:39
Copy link

github-actions bot commented Sep 19, 2025

🔍 Preview links for changed docs

@vishaangelova vishaangelova force-pushed the 1780-clarify-support-for-dynamic-topics branch 2 times, most recently from 8911143 to dbd2c18 Compare September 19, 2025 13:54
@vishaangelova vishaangelova force-pushed the 1780-clarify-support-for-dynamic-topics branch from dbd2c18 to 959df7d Compare September 19, 2025 14:01
@vishaangelova vishaangelova changed the title Extend the topic setting description for the Kafka output Extend the topic description for the Kafka output Sep 19, 2025
@vishaangelova
Copy link
Contributor Author

@kpollich in the issue, you mentioned

The proposed workflow here would be to add the block above to any integration policies on Fleet-managed agents or to the input config on any standalone agents that output to Kafka

So I made an assumption that dynamic values can also be set for topic in the Kafka output configuration for standalone agents. Since that information was not in the doc, I copied it from the doc for Fleet-managed agents. I hope I’m not wrong...

Copy link
Contributor

@benironside benironside left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, left one minor suggestion

Copy link
Member

@kpollich kpollich left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thank you! 🚀

@vishaangelova vishaangelova enabled auto-merge (squash) September 23, 2025 13:37
@vishaangelova vishaangelova merged commit 3830e27 into main Sep 23, 2025
7 checks passed
@vishaangelova vishaangelova deleted the 1780-clarify-support-for-dynamic-topics branch September 23, 2025 13:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[REQUEST]: Make recommendation for add_fields as a means to support complex dynamic Kafka topics more prominent
4 participants