Fluentd Out File parser plugin for Embulk
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
config/checkstyle
gradle/wrapper
lib/embulk
src
.gitignore
.travis.yml
CHANGELOG.md
README.md
build.gradle
embulk-parser-fluentd_out_file.gemspec
gradlew
gradlew.bat

README.md

Fluentd Out File parser plugin for Embulk

This plugin parses fluentd's out_file formatted files. http://docs.fluentd.org/articles/out_file

Overview

  • Plugin type: parser
  • Guess supported: yes

Configuration

  • delimiter: Delimiter character such as \t (string, required)
  • columns: Columns (hash, required)

Example

in:
  type: any file input plugin type
  parser:
    type: fluentd_out_file
    delimiter: "\t"
    columns:
    - {name: time, type: timestamp, format: '%Y-%m-%dT%H:%M:%S%:z'}
    - {name: tag, type: string}
    - {name: record, type: json}

(If guess supported) you don't have to write parser: section in the configuration file. After writing in: section, you can let embulk guess parser: section using this command:

$ embulk gem install embulk-parser-fluentd_out_file
$ embulk guess -g fluentd_out_file config.yml -o guessed.yml

Build

$ ./gradlew gem  # -t to watch change of files and rebuild continuously

Test

$ ./gradlew clean test jacocoTestReport