Skip to content

[beatreceivers] Enable otel runtime by default for kafka and logstash output#13514

Merged
khushijain21 merged 10 commits intoelastic:mainfrom
khushijain21:enable-otel
Apr 10, 2026
Merged

[beatreceivers] Enable otel runtime by default for kafka and logstash output#13514
khushijain21 merged 10 commits intoelastic:mainfrom
khushijain21:enable-otel

Conversation

@khushijain21
Copy link
Copy Markdown
Contributor

@khushijain21 khushijain21 commented Apr 7, 2026

What does this PR do?

This PR enables inputs using logstash or kafka output to run in OTel mode (This will be default runtime for inputs already running on otel runtime by default)

Why is it important?

This is required to allow inputs using outputs other than elasticsearch to use OTel mode

Checklist

  • I have read and understood the pull request guidelines of this project.
  • My code follows the style guidelines of this project
  • I have commented my code, particularly in hard-to-understand areas
  • I have made corresponding changes to the documentation
  • I have made corresponding change to the default configuration files
  • I have added tests that prove my fix is effective or that my feature works
  • I have added an entry in ./changelog/fragments using the changelog tool
  • I have added an integration test or an E2E test

Disruptive User Impact

Will be monitored

How to test this PR locally

Run elastic-agent with any metric input with kafka/logstash output

Related issues

@mergify
Copy link
Copy Markdown
Contributor

mergify bot commented Apr 7, 2026

This pull request does not have a backport label. Could you fix it @khushijain21? 🙏
To fixup this pull request, you need to add the backport labels for the needed
branches, such as:

  • backport-./d./d is the label that automatically backports to the 8./d branch. /d is the digit
  • backport-active-all is the label that automatically backports to all active branches.
  • backport-active-8 is the label that automatically backports to all active minor branches for the 8 major.
  • backport-active-9 is the label that automatically backports to all active minor branches for the 9 major.

@khushijain21 khushijain21 changed the title Enable otel runtime by default for kafka and logstash output [beatreceivers] Enable otel runtime by default for kafka and logstash output Apr 7, 2026
@khushijain21 khushijain21 marked this pull request as ready for review April 7, 2026 15:42
@khushijain21 khushijain21 requested a review from a team as a code owner April 7, 2026 15:42
@khushijain21 khushijain21 enabled auto-merge (squash) April 7, 2026 15:44
Copy link
Copy Markdown
Member

@mauri870 mauri870 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM Very simple change, but I'm under the impression that changing the runtime would require changes in test assertions.

@khushijain21 khushijain21 disabled auto-merge April 8, 2026 02:17
@khushijain21 khushijain21 enabled auto-merge (squash) April 8, 2026 02:17
@mauri870
Copy link
Copy Markdown
Member

mauri870 commented Apr 8, 2026

/test

@cmacknz cmacknz added the backport-9.4 Automated backport to the 9.4 branch label Apr 9, 2026
@cmacknz
Copy link
Copy Markdown
Member

cmacknz commented Apr 9, 2026

Added backport-9.4 lable now that the branch exists.

@elasticmachine
Copy link
Copy Markdown
Contributor

elasticmachine commented Apr 10, 2026

⏳ Build in-progress, with failures

Failed CI Steps

History

cc @khushijain21

@khushijain21 khushijain21 merged commit 93d94eb into elastic:main Apr 10, 2026
28 of 32 checks passed
mergify bot pushed a commit that referenced this pull request Apr 10, 2026
… output (#13514)

* Enable otel runtime by default for kafka and logstash output

* add changelog

* remove default pref

---------

Co-authored-by: Mauri de Souza Meneguzzo <mauri870@gmail.com>
(cherry picked from commit 93d94eb)
v1v added a commit to michel-laterman/elastic-agent that referenced this pull request Apr 15, 2026
…l-laterman/elastic-agent into feature/oblt-cli-win-arm64

* 'feature/oblt-cli-win-arm64' of https://github.com/michel-laterman/elastic-agent:
  [main][Automation] Update elastic/beats to 323f731f84e5 (elastic#13622)
  Update OTel Collector components to v0.149.0/v1.55.0 (elastic#13599)
  build(deps): bump peter-evans/create-pull-request from 8.1.0 to 8.1.1 (elastic#13593)
  Fix clean stopping of beats on windows (elastic#13581)
  Handle multiple values for fleet and kibana headers (elastic#13506)
  [otel/kube-stack] Update the OpenTelemetry Kube Stack Helm Chart to latest versions (elastic#13522)
  Automate updates to opentelemetry-collector-components (elastic#13578)
  [beatreceiver] Add integration testing for kafka output (elastic#13550)
  Bump the version on main to 9.5.0 (elastic#13532)
  [beatreceivers] Enable otel runtime by default for kafka and logstash output (elastic#13514)
  Add Elastic Agent 9.3.3+IAR release notes (elastic#13556)
  fix(flake): clean up prefix install data dirs in RPM test fixture (elastic#13552)
  [Automation] Bump Golang version to 1.25.9 (elastic#13559)
  feat(helm): add support for Fleet URL and token from Kubernetes Secret (elastic#13507)
mauri870 added a commit that referenced this pull request Apr 15, 2026
… output (#13514) (#13580)

* Enable otel runtime by default for kafka and logstash output

* add changelog

* remove default pref

---------


(cherry picked from commit 93d94eb)

Co-authored-by: Khushi Jain <khushi.jain@elastic.co>
Co-authored-by: Mauri de Souza Meneguzzo <mauri870@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport-9.4 Automated backport to the 9.4 branch

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants