Skip to content
No description, website, or topics provided.
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
config/checkstyle
example
gradle/wrapper
lib/embulk/formatter
src
.gitignore
LICENSE.txt
README.md
build.gradle
gradlew
gradlew.bat

README.md

Avro formatter plugin for Embulk

Avro formatter plugin for Embulk.

Overview

  • Plugin type: formatter

Support avro types

Support all avro basic types.

  • string
  • int
  • long
  • float
  • double
  • boolean
  • enum
  • fixed
  • array
  • map
  • record

But typecasting is restricted by embulk column type. See. AvroValueConverters,

Configuration

  • avsc: avro schema (avsc) filepath (string, required)
  • codec: avro codec type (enum: deflate, bzip2, xz, snappy, optional)
  • compression_level: avro codec compression level (integer, optional, for only deflate and xz codec)
  • skip_error_record: If you want to skip error record, set true (boolean, default: false)

Example

out:
  type: file
  path_prefix: ./out_
  file_ext: avro
  formatter:
    type: avro
    avsc: schema.avsc
    skip_error_record: true

Build

$ ./gradlew gem  # -t to watch change of files and rebuild continuously
You can’t perform that action at this time.