Mongodb output plugin for Embulk

input source중에 지정된 필드를 subdocument로 만들어서 몽고DB로 저장한다

Dumps records to Mongodb with subdocument

Overview

• Plugin type: output
• Load all or nothing: no
• Resume supported: no
• Cleanup supported: no

Configuration

• type: mongodb_nest (string, required)
• host: host name (string, required)
• port: port number (integer, default: 27017)
• database: database name (string, required)
• user: mongodb account (string, required)
• password: password (string, required)
• collection: collection name (string, required)
• key: primary keys of collection (string array, required, since v0.1.2)
• child: describe subdocument (object list, default: null)
• bulk_size: bulk upsert size at time (integer, default: 10000)
• null_value: set the value to fill if the field value is null (object, optional, since v0.1.3)
  • string : default string value (string, default: "")
  • long : default long value (long, default: 0)
  • boolean : default boolean value (boolean, default: false)
  • double : default double value (double, default: 0.0)
  • json : default json value (object, default: "{}")
  • timestamp : default timestamp value (timestamp, default : "1970-01-01T00:00:00.000Z")

Example

• default configuration

out:
  type: mongodb_nest
  host: your-host-name
  database: your-database-name
  user: your-account-name
  password: your-password
  collection: your-collection-name
  key: [your-key1, key2, ...]
  child:
  - {name: mychild, field: time}
  - {name: yourchild, field: comment}
  - {name: mychild, field: purchase}
  null_value:
    string: ""
    long: -1
    json: {key: value}
    boolean: false
    double: 0.0
    timestamp: "1970-01-01T00:00:00.000Z"

• Embulk input csv sample configuration

in:
  type: file
  path_prefix: /Users/focuschange/google/program/embulk/try1/csv/sample_
  decoders:
  - {type: gzip}
  parser:
    charset: UTF-8
    newline: LF
    type: csv
    delimiter: ','
    quote: '"'
    escape: '"'
    null_string: 'NULL'
    trim_if_not_quoted: false
    skip_header_lines: 1
    allow_extra_columns: false
    allow_optional_columns: false
    columns:
    - {name: id, type: long}
    - {name: account, type: long}
    - {name: time, type: timestamp, format: '%Y-%m-%d %H:%M:%S'}
    - {name: purchase, type: timestamp, format: '%Y%m%d'}
    - {name: comment, type: string}
out:
  type: mongodb_nest
  host: your-host-name
  database: your-database-name
  user: your-account-name
  password: your-password
  collection: your-collection-name
  key: [your-key, key2]
  child:
  - {name: mychild, field: time}
  - {name: yourchild, field: comment}
  - {name: mychild, field: purchase}
  null_value:
    string: ""
    long: -1
    json: {key: value}
    timestamp: "1990-01-01T00:00:00.000Z"

Release

• 0.1.3 2018-06-25 set the value to fill if the field value is null
• 0.1.2 2018-06-08 The key field has been changed to a list type. The JSON Parser is supported by the input plugin.
• 0.1.1 2018-06-05 [bug fix] Fiexed an error when a child field was entered
• 0.1.0 2018-05-31 first release