No description, website, or topics provided.
Java Ruby
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
config/checkstyle
gradle/wrapper
lib/embulk
src
.gitignore
LICENSE.txt
README.md
build.gradle
gradlew
gradlew.bat

README.md

Xml2 parser plugin for Embulk

Embulk parser plugin for parsing xml data. this plugin uses SAX parser, so you can parse very huge XML data with this plugin. also, support parsing sub-element under the root element which you specified. so you can parse and expand data more flexibly.

Overview

  • Plugin type: parser
  • Guess supported: no

Configuration

  • type: specify this plugin as "xml2" (string, required)
  • root: root element to start fetching each entries (integer, required)
  • schema: specify the attribute of table and data type (required)

Example

parser:
  type: xml2
  root: mediawiki/page
  schema:
    - { name: id, type: long }
    - { name: title, type: string }
    - { name: revision/timestamp, type: timestamp, format: '%Y-%m-%dT%H:%M:%SZ' }
    - { name: revision/text, type: string }

Then you can fetch entries from the following xml (wikipedia archive xml format.) :

<mediawiki>
  <page>
    <id>1</id>
    <title>title 1</title>
    <revision>
      <timestamp>2004-04-30T14:46:00Z</timestamp>
      <text>body text</text>
    </revision>
  </page>
  <page>
    <id>2</id>
    <title>title 2</title>
    <revision>
      <timestamp>2004-04-30T14:46:00Z</timestamp>
      <text>body text</text>
    </revision>
  </page>
</mediawiki>

Build

$ ./gradlew gem  

How to send Pull Request

If you would like to send a patch or Pull Request to this repository, please agree with our CLA before that. Please check following steps.

  1. You send Pull Request to our Yahoo! JAPAN OSS.
  2. We send you CLA to get agreement from you.
  1. You agree with the CLA.
  2. We review your Pull Request and merge it.