Skip to content

A no frills fluentd buffered plugin to write to microsoft sql server

Notifications You must be signed in to change notification settings

u89012/fluent-plugin-mssql2

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Fluent::Plugin::Mssql2

A no frills fluentd buffered plugin to write to microsoft sql server. Uses tiny_tds and sequel for the actual weightlifting.

Extracts and writes any matching JSON packet to a preconfigred SQL Server table (see usage below)

Requirement

You should install and setup following packages;

Installation

Install Ruby and any prerequisites (assuming Debian distro)

$ sudo apt-get install build-essential ruby2.0 ruby-dev unixODBC freetds-dev

Install Fluentd gem. Follow the well written documentation [http://docs.fluentd.org/articles/install-by-gem]

Install fluent-plugin-mssql2 gem and its deps

$ sudo gem install sequel tiny_tds fluent-plugin-mssql2

Alternatively, add this line to your application's Gemfile:

gem 'tiny_tds'
gem 'sequel'
gem 'fluent-plugin-mssql2'

And then execute:

$ bundle

Usage

Add a matcher in your fluent.conf file like so

<match insert.into.mssql2.*>
    type     mssql2
    username sa
    password secret
    host     foo
    database bar
    table    baz
    
    flush_interval 15s
</match>

Fire up your fluentd

$ fluentd -c ./fluent/fluent.conf -vv

Make sure the approriate tables are created in sql server and then test it like so

$ echo '{"msg":"here comes the sun"}' | fluent-cat insert.into.mssql2.test
$ for i in `seq 2000 2100`; do echo "{\"msg\":\"here comes the sun, part $i\"}" | fluent-cat insert.into.mssql2.test; done

If everything goes well, you should see your JSON data in your table as a row

Thanks

Hidemasa Togashi for his work on fluent-plugin-mssql [https://github.com/htgc/fluent-plugin-mssql] on which this is based

Licence

  • MIT

Contributing

  1. Fork it ( http://github.com/u89012/fluent-plugin-mssql2/fork )
  2. Create your feature branch (git checkout -b my-new-feature)
  3. Commit your changes (git commit -am 'Add some feature')
  4. Push to the branch (git push origin my-new-feature)
  5. Create new Pull Request

About

A no frills fluentd buffered plugin to write to microsoft sql server

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages