A no frills fluentd buffered plugin to write to microsoft sql server
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
lib/fluent/plugin
.gitignore
README.md updated readme Jul 11, 2014
fluent-plugin-mssql2.gemspec

README.md

Fluent::Plugin::Mssql2

A no frills fluentd buffered plugin to write to microsoft sql server. Uses tiny_tds and sequel for the actual weightlifting.

Extracts and writes any matching JSON packet to a preconfigred SQL Server table (see usage below)

Requirement

You should install and setup following packages;

Installation

Install Ruby and any prerequisites (assuming Debian distro)

$ sudo apt-get install build-essential ruby2.0 ruby-dev unixODBC freetds-dev

Install Fluentd gem. Follow the well written documentation [http://docs.fluentd.org/articles/install-by-gem]

Install fluent-plugin-mssql2 gem and its deps

$ sudo gem install sequel tiny_tds fluent-plugin-mssql2

Alternatively, add this line to your application's Gemfile:

gem 'tiny_tds'
gem 'sequel'
gem 'fluent-plugin-mssql2'

And then execute:

$ bundle

Usage

Add a matcher in your fluent.conf file like so

<match insert.into.mssql2.*>
    type     mssql2
    username sa
    password secret
    host     foo
    database bar
    table    baz
    
    flush_interval 15s
</match>

Fire up your fluentd

$ fluentd -c ./fluent/fluent.conf -vv

Make sure the approriate tables are created in sql server and then test it like so

$ echo '{"msg":"here comes the sun"}' | fluent-cat insert.into.mssql2.test
$ for i in `seq 2000 2100`; do echo "{\"msg\":\"here comes the sun, part $i\"}" | fluent-cat insert.into.mssql2.test; done

If everything goes well, you should see your JSON data in your table as a row

Thanks

Hidemasa Togashi for his work on fluent-plugin-mssql [https://github.com/htgc/fluent-plugin-mssql] on which this is based

Licence

  • MIT

Contributing

  1. Fork it ( http://github.com/u89012/fluent-plugin-mssql2/fork )
  2. Create your feature branch (git checkout -b my-new-feature)
  3. Commit your changes (git commit -am 'Add some feature')
  4. Push to the branch (git push origin my-new-feature)
  5. Create new Pull Request