has been deprecated, just install embulk-parser-jsonpath; Embulk parser plugin for json with jsonpath
Switch branches/tags
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
lib/embulk/parser say deprecated Mar 13, 2017
.gitignore initial Mar 14, 2015
Gemfile initial Mar 14, 2015
LICENSE.txt initial Mar 14, 2015
README.md say deprecated Mar 13, 2017
Rakefile
embulk-parser-json.gemspec bump up Mar 14, 2017

README.md

Deprecated

'embulk-parser-json' has been deprecated.

Just use embulk-parser-jsonpath instead.

Json parser plugin for Embulk

Parser plugin for Embulk.

Read data from input as json and fetch each entries by jsonpath to output.

Overview

  • Plugin type: parser
  • Load all or nothing: yes
  • Resume supported: no

Breaking changes

A type name has been changed from json to jsonpath from v0.0.3.

Configuration

parser:
  type: jsonpath
  root: $.response.station
  stop_on_invalid_record: false
  schema:
    - {name: name, type: string}
    - {name: next, type: string}
    - {name: prev, type: string}
    - {name: distance, type: string}
    - {name: lat, type: double, path: x}
    - {name: lng, type: double, path: y}
    - {name: line, type: string}
    - {name: postal, type: string}
    - {name: optionals, type: json}
  • type: Specify this plugin as json
  • root: Root property to start fetching each entries, specify in jsonpath style, required
  • schema: Specify the attribute of table and data type, required
  • stop_on_invalid_record: Stop bulk load transaction if a file includes invalid record, false by default

Example

{
    "result" : "success",
    "students" : [
      { "name" : "John", "age" : 10 },
      { "name" : "Paul", "age" : 16 },
      { "name" : "George", "age" : 17 },
      { "name" : "Ringo", "age" : 18 }
    ]
}

Simple schema

You can iterate "students" node by the following condifuration:

root: $.students
schema:
  - {name: name, type: string}
  - {name: age, type: long}

Handle more complicated json

If you want to handle more complicated json, you can specify jsonpath to also path in schema section like as follows:

{
    "result" : "success",
    "students" : [
      { "names" : ["John", "Lennon"], "age" : 10 },
      { "names" : ["Paul", "Maccartney"], "age" : 10 }
    ]
}
root: $.students
schema:
  - {name: firstName, type: string, path: "names[0]"}
  - {name: lastName, type: string, path: "names[1]"}

In this case, names[0] will be firstName of schema and names[1] will be lastName.