Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Load data into tables #1

Open
schultyy opened this issue Aug 20, 2017 · 1 comment
Open

Load data into tables #1

schultyy opened this issue Aug 20, 2017 · 1 comment

Comments

@schultyy
Copy link
Owner

To make sure, that diagnostic is able to process a log file without the need to recompile it with an adequate regular expression, the regular expressions + field definitions have to be managed in a configuration file.

This configuration file needs to map a log file type on columns and a regular expression.

This looks like this:

[
  {
    "type": "travis_log_last_2000.log",
    "columns": [
      "severity",
      "date",
      "message",
      "component"   
    ],
    "regex": "..."
  }
]

When a log file gets read its data gets stored in a table like structure.

@schultyy
Copy link
Owner Author

Maybe it makes sense to map each field on a regular expression. Then it gets easier to extract the things we are actually interested in.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant