VRL doesn't have the ability read some filed from a certern file

[lusvan]

When i transforms my old log to a standard format log, I need to add many new filed that not exist in the old log file. These new fileds come from other config files. Is the any way to read them?

[jszwedko]

Hi @lusvan !

There is an enrichment table feature that might be able to help here. This feature allows reading a CSV file and performing lookups to map fields. See an example here: https://github.com/vectordotdev/vector-demos/tree/main/csv-enrichment

Let me know what you think!

[lusvan]

Hi, Thanks for replying I solve the problem : 1. Parsing log by  VRL. 2. Delivering the event to lua transform process.  3. Just perform a pipe system in Lua hookinit to get what I need.  

…

---Original--- From: "Jesse ***@***.***> Date: Wed, Mar 23, 2022 23:59 PM To: ***@***.***>; Cc: ***@***.******@***.***>; Subject: Re: [vectordotdev/vector] VRL doesn't have the ability read somefiled from a certern file (Discussion #11956) Hi @lusvan ! There is an enrichment table feature that might be able to help here. This feature allows reading a CSV file and performing lookups to map fields. See an example here: https://github.com/vectordotdev/vector-demos/tree/main/csv-enrichment Let me know what you think! — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you were mentioned.Message ID: ***@***.***>

[jszwedko]

Ah, gotcha, yeah the lua transform is another good option.