Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Splunk Hec Exporter - unparsed raw event output #18056

Closed
greatestusername-splunk opened this issue Jan 26, 2023 · 5 comments
Closed

Splunk Hec Exporter - unparsed raw event output #18056

greatestusername-splunk opened this issue Jan 26, 2023 · 5 comments
Labels

Comments

@greatestusername-splunk

Component(s)

exporter/splunkhec

Is your feature request related to a problem? Please describe.

Ability to send data out to splunk instance as raw text using the raw endpoint.

Currently exporter munges incoming logs into a "hec formatted" event. Adding fields such as host and jamming all of the raw payload into event.

Would be amazing to have a setting to just pass raw through unparsed and have it be treated as raw at splunk index time.

This would enable using the https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/receiver/splunkhecreceiver receiver as a generic webhook receiver, that can then be passed easily on to splunk while handling token auth.

Describe the solution you'd like

A setting to just pass raw through unparsed and have it be treated as raw at splunk index time.

This would enable using the https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/receiver/splunkhecreceiver receiver as a generic webhook receiver, that can then be passed easily on to splunk while handling header auth.

Describe alternatives you've considered

Not certain there are other options.

Additional context

If there is a better way to get generic webhook data out to Splunk as raw text from otel, would be happy to know!

@greatestusername-splunk greatestusername-splunk added enhancement New feature or request needs triage New item requiring triage labels Jan 26, 2023
@github-actions
Copy link
Contributor

Pinging code owners:

See Adding Labels via Comments if you do not have permissions to add labels yourself.

@atoulme atoulme added priority:p2 Medium and removed needs triage New item requiring triage labels Jan 26, 2023
@atoulme
Copy link
Contributor

atoulme commented Jan 26, 2023

That's definitely doable, for logs only obviously. To reiterate some of what we talked about directly:

  • This means you lose any metadata - including index, timestamp, etc. Maybe you can cheat and add this metadata to the hec url.
  • Only works for logs, obviously.

@greatestusername-splunk
Copy link
Author

Definitely! All sorta goes without saying but MUST be said!
Timestamp will be fine added at index time for most use cases. Any that don't should include times/timestamps/epoch or some other data anyway. If they don't... more magic tricks can get it there. :)

@atoulme
Copy link
Contributor

atoulme commented Jan 31, 2023

Done!

@atoulme atoulme closed this as completed Jan 31, 2023
@greatestusername-splunk
Copy link
Author

You're the very best! like no one ever was! 🎵
TY!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants