Skip to content
This repository has been archived by the owner on Nov 16, 2023. It is now read-only.

Time field needs to be forced to appear at beginning of event #9

Closed
jijulukose opened this issue Sep 17, 2018 · 5 comments
Closed

Time field needs to be forced to appear at beginning of event #9

jijulukose opened this issue Sep 17, 2018 · 5 comments

Comments

@jijulukose
Copy link

Splunk's default MAX_TIMESTAMP_LOOKAHEAD is 128 bytes. Unless the event's time field comes within that, Splunk is going to take HEC event received time as event's time which may not be desirable in some cases.
Time field must be forced to appear at the beginning of all event/source types.

@sebastus
Copy link
Contributor

sebastus commented Nov 9, 2018

@jijulukose Apologies for the delay getting to this. I'll take a look.
Can you give me a before/after example? Are you asking that each new message be refactored to move the time field?

@ScottyMac52
Copy link

Any word on this?

@sebastus
Copy link
Contributor

sebastus commented Feb 8, 2019 via email

@sebastus
Copy link
Contributor

sebastus commented Feb 22, 2019

This isn't as easy as you might think. The messages come from many different resources and each has its own format. On top of that, new resources emit into the same event hub as they come online. This means that I can't write a dotnet object for each of them to de-serialize into, placing "time" at the beginning.
Does it matter the name of the time property? I can add an extra time field and put it up front. Or - maybe better - I can add "time" to the event metadata - as mentioned on this page: http://dev.splunk.com/view/event-collector/SP-CAAAE6P

@sebastus
Copy link
Contributor

I added time to the splunk event metadata. The time of the event is extracted from the message itself and converted to epoch according to HEC metadata definition. This is in the master branch.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants