Skip to content
master
Switch branches/tags
Go to file
Code

Latest commit

 

Git stats

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
 
 
 
 
src
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

README.md

Copy filter plugin for Embulk

Release CI Status Badge Test CI Status Badge

Copy records and run another embulk by using them as input data source.

The Document for Japanese is here.

Overview

  • Plugin type: filter

Configuration

  • copy: Another embulk configurations except in. (array of CopyEmbulkConfig, optional)
    • Either copy or config option is required.
    • When config option is removed, this option become a required option.
  • config: [DEPRECATED: Use copy option] Another embulk configurations except in. (CopyEmbulkConfig, optional)

Configuration for CopyEmbulkConfig

  • name: The name of the bulk load to copy. (string, optional)
  • exec: The embulk executor plugin configuration. (config, optional)
    • max_threads: The maximum number of threads for that the bulk load runs concurrently. (int, default: The number of available CPU cores)
  • filters: The embulk filter plugin configurations. (array of config, default: [])
  • out: The embulk output plugin configuration.

Example

filters:
  - type: copy
    copy:
      - name: copy-01
        filters:
          - type: remove_columns
            remove: ["t"]
        out:
          type: stdout
      - exec:
          max_threads: 4
        filters:
          - type: remove_columns
            remove: ["payload"]
        out:
          type: stdout

Development

Run the example

$ ./gradlew gem
$ embulk run example/config.yml -Ibuild/gemContents/lib

Run tests

$ ./gradlew scalatest

Build

$ ./gradlew gem --write-locks  # -t to watch change of files and rebuild continuously

Release gem

Fix build.gradle, then

$ ./gradlew gemPush

CHANGELOG

CHANGELOG.md

License

MIT LICENSE

About

No description, website, or topics provided.

Resources

License

Sponsor this project

 

Packages

No packages published

Languages