Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Invalid indentation level due to too long of regex #1149

Open
jamesgoodhouse opened this issue Mar 1, 2019 · 1 comment
Open

Invalid indentation level due to too long of regex #1149

jamesgoodhouse opened this issue Mar 1, 2019 · 1 comment
Assignees

Comments

@jamesgoodhouse
Copy link
Contributor

Bug Report

Describe the bug
When using a custom regex parser with a very long Regex, I receive the error Invalid indentation level when running Fluent Bit. This appears to be similar to issue #301 where the line buffer is not long enough.

To Reproduce
Create a parser with a very long Regex. I am using one that is currently 4,365 characters.

[PARSER]
    Name    test_parser
    Format  regex
    Regex   <<SUPER LONG REGEX HERE>

Consume said parser with a parser filter.

[FILTER]
    Name      parser
    Match     *
    Key_Name  log
    Parser    test_parser

Start Fluent Bit and you'll receive the error Invalid indentation level. Fluent Bit will also fail to start.

Expected behavior
I expect Fluent Bit to start without error or quitting and for my logs to be properly parsed.

Screenshots
N/A

Your Environment

  • Version used: 1.0.4 (Docker version)
  • Operating System and version: MacOS running containerized Fluent Bit
  • Filters and plugins: Parser and Parser Filter

Additional context
We are parsing some complicated log for OpenLDAP and thus need a pretty gnarly regex to be able to parse and extract all of the fields.

@edsiper
Copy link
Member

edsiper commented Mar 27, 2019

@jamesgoodhouse current limit is 4095 bytes.

I will see if we can make it bigger for a future release, but 4KB is a lot! :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants