No description or website provided.
Kotlin Other
Latest commit 1ae25e3 Feb 16, 2017 @kamatama41 committed on GitHub Merge pull request #32 from kamatama41/fix-checkstyle
Fix checkstyle warns
Failed to load latest commit information.
config/checkstyle Update to current plugin format Feb 14, 2017
gradle/wrapper Update gradle Feb 2, 2017
src Fix checkstyle warns Feb 16, 2017
Dockerfile Replace using image to reduce build time Jan 12, 2017
LICENSE.txt First commit. Apr 14, 2015
build.gradle Fix checkstyle warns Feb 16, 2017
docker-compose.yml Use docker-compose instead of docker Jan 22, 2017
gradlew Update gradle to the latest Jan 30, 2017
gradlew.bat Update gradle to the latest Jan 30, 2017

Build Status

Remote file input plugin for Embulk

This plugin load data from Remote hosts by SCP


  • Plugin type: file input
  • Resume supported: yes
  • Cleanup supported: yes


  • hosts: Target hosts, format should be host or host:port (overrides default_port) (list, default: [])
  • hosts_command: Command for getting hosts(Windows not supported). If given the option, "hosts" is overwritten. (string, default: null)
  • hosts_separator: Separator for "hosts_command" result (string, default: " ")
  • default_port: Default port number for SSH (integer, default: 22)
  • path: Path of remote host (File or Directory) (string, default: "")
  • path_command: Command for getting path (Windows not supported). If given the option "path" is overwritten. (string, default: null)
  • ignore_not_found_hosts: If the option is true, Hosts which meet the following conditions are skipped. (Means they are not included into resume target.) (boolean, default: false)
    • Target file (or directory) isn't found
    • Occurred SSH error
  • auth: SSH authentication setting (hash, default: {})
    • user: SSH username (string, default: execute user)
    • type: public_key or password (string, default: public_key)
    • key_path: Path of secret key (If you choose type "public_key") (string, default: "~/.ssh/id_rsa or id_dsa")
    • password: SSH password (If you choose type "password") (string)
    • skip_host_key_verification: If the option is true, HostKey verification will be skipped (boolean, default: false)


  type: remote
    - host1
    - host2:10022
#  hosts_command: echo 'host1,host2'
#  hosts_separator: ','
  path: /some/path/20150414125923
#  path_command: echo /some/path/`date "+%Y%m%d%H%M%S"`
  ignore_not_found_hosts: true
    user: {username}
    type: public_key
    key_path: /usr/home/.ssh/id_rsa
#    type: password
#    password: {password}


When this plugin run on Linux, a task might be blocked.
The cause is Please try one of the followings.


$ embulk run config.yml

rewrite ${JAVA_HOME}/jre/lib/security/

# securerandom.source=file:/dev/random # before
securerandom.source=file:/dev/./urandom # after

see also

Development on local machine

  • Install Docker and then we can create SSH-able containers
$ ssh-keygen -t ecdsa -f ./id_rsa_test -N ''
$ docker-compose up -d
$ docker-compose ps
          Name                 Command       State           Ports         
embulkinputremote_host1_1   /   Up>22/tcp 
embulkinputremote_host2_1   /   Up>22/tcp 


$ ./gradlew gem