Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add field content mapping as extractor/converter #644

Open
kroepke opened this issue Aug 1, 2014 · 3 comments
Open

Add field content mapping as extractor/converter #644

kroepke opened this issue Aug 1, 2014 · 3 comments

Comments

@kroepke
Copy link
Member

kroepke commented Aug 1, 2014

Sometimes it is useful to map field values to other representations while extracting data.
For example the redis severity is a single character, but it would be nice if it was represented just like the syslog severity.

Add a converter type that supports a hash lookup table. That table could be static, or periodically refreshed from some external source.
Be careful to make the converter code path very fast and if the converter is updatable, that should happen on a different thread, replacing the entire table without taking locks.

via a mailing list post

@runningman84
Copy link

another use case are firewall logs, you get actions like:

permit
accept
Permitted
allow

these should all map to permit.

@bernd
Copy link
Member

bernd commented Feb 27, 2015

See also #302

@kroepke
Copy link
Member Author

kroepke commented Apr 22, 2016

Some of this is now possible using the pipeline processing feature in 2.0:
https://gist.github.com/kroepke/27de3bfa2123c5b9ef091888068526cb

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants