Skip to content
master
Switch branches/tags
Code

Latest commit

 

Git stats

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
 
 
 
 
 
 
 
 
 
 
 
 

Query String Ruby filter plugin for Embulk

Overview

  • Plugin type: filter

Configuration

  • column: target column name (string, required)
  • schema: schema of query parameter (array, default: [], required)

Example

sample data

id,account,time,purchase,comment,query
1,32864,2015-01-27 19:23:49,20150127,embulk,http://hoge.com?hoge=aa&fuga=1
2,14824,2015-01-27 19:01:23,20150127,embulk jruby,?hoge=aa&fuga=1
3,27559,2015-01-28 02:20:02,20150128,"Embulk ""csv"" parser plugin",hoge=aa&fuga=1&piyo=2017-10-01
4,11270,2015-01-29 11:54:36,20150129,NULL,hoge=aafuga=1

configuration

filters:
  - type: query_string_ruby
    column: query_string
    schema: 
      - {name: hoge, type: string}
      - {name: fuga, type: long}
      - {name: piyo, type: timestamp}

result

+---------+--------------+-------------------------+-------------------------+----------------------------+--------------------------------+-------------+-----------+-------------------------+
| id:long | account:long |          time:timestamp |      purchase:timestamp |             comment:string |                   query:string | hoge:string | fuga:long |          piyo:timestamp |
+---------+--------------+-------------------------+-------------------------+----------------------------+--------------------------------+-------------+-----------+-------------------------+
|       1 |       32,864 | 2015-01-27 19:23:49 UTC | 2015-01-27 00:00:00 UTC |                     embulk | http://hoge.com?hoge=aa&fuga=1 |          aa |         1 |                         |
|       2 |       14,824 | 2015-01-27 19:01:23 UTC | 2015-01-27 00:00:00 UTC |               embulk jruby |                ?hoge=aa&fuga=1 |          aa |         1 |                         |
|       3 |       27,559 | 2015-01-28 02:20:02 UTC | 2015-01-28 00:00:00 UTC | Embulk "csv" parser plugin | hoge=aa&fuga=1&piyo=2017-10-01 |          aa |         1 | 2017-09-30 15:00:00 UTC |
|       4 |       11,270 | 2015-01-29 11:54:36 UTC | 2015-01-29 00:00:00 UTC |                            |                  hoge=aafuga=1 |    aafuga=1 |           |                         |
+---------+--------------+-------------------------+-------------------------+----------------------------+--------------------------------+-------------+-----------+-------------------------+

Build

$ rake

About

No description, website, or topics provided.

Resources

License

Packages

No packages published

Languages