No description, website, or topics provided.
Switch branches/tags
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
config/checkstyle
example
gradle/wrapper
lib/embulk/filter
src
.gitignore
CHANGELOG.md
LICENSE.txt
README.md
build.gradle
gradlew
gradlew.bat
settings.gradle

README.md

Copy filter plugin for Embulk

Copy records and run another embulk by using them as input data source.

The Document for Japanese is here.

Overview

  • Plugin type: filter

Configuration

Example

filters:
  - type: copy
    config:
      filters:
        - type: remove_columns
          remove: ["id"]
      out:
        type: stdout
      exec:
        max_threads: 8

Note

  • This plugin works only on Java 1.8 or later.
  • This plugin is experimental yet, so the specification may be changed.
  • This plugin has more options than I write, but I do not write them because you do not have to change them currently.
  • This plugin has no test yet, so may have some bugs.
  • This plugin does not work on embulk-executor-mapreduce yet.
  • This plugin uses lots of memory now, because embulk run twice.
  • Specification about error handling is not yet fixed.
  • If you have any problems or opinions, I'm glad if you raise Issue.

Dependencies

Development

Run example:

$ ./gradlew classpath
$ embulk run example/config.yml -Ilib

Run test:

$ ./gradlew test

Release gem:

Fix build.gradle, then

$ ./gradlew gemPush

ChangeLog

CHANGELOG.md