thbar / etl-goodies

Click here to lend your support to: etl-goodies and make a donation at www.pledgie.com !

A few useful things for ActiveWarehouse-ETL and the likes

This URL has Read+Write access

name age
history
message
file LICENSE Thu May 14 14:28:27 -0700 2009 Pushing a good bunch of tools out there [thbar]
file README.textile Thu May 14 14:28:27 -0700 2009 Pushing a good bunch of tools out there [thbar]
file Rakefile Thu May 14 14:28:27 -0700 2009 Pushing a good bunch of tools out there [thbar]
directory lib/ Thu May 14 14:28:27 -0700 2009 Pushing a good bunch of tools out there [thbar]
directory spec/ Thu May 14 14:28:27 -0700 2009 Pushing a good bunch of tools out there [thbar]
README.textile

WHAT’S HERE ?

I’m sharing tools I’m using when I build Datawarehouses using ActiveWarehouse-ETL.

QUICK DESCRIPTION

  • CsvHelper – allows to:
    • extract csv columns names in a stable fashion
    • returns all the values of a specific column
  • FixedWidthFileDestination : if you’re outputting stuff to COBOL machines
  • DimensionMigrationHelper : useful for ActiveRecord migrations
  • French(Date/Time)DimensionBuilder : fine-grained date/time dimensions in french
  • EnsureFieldsPresenceProcessor : raises error as soon as one field is missing from a row
  • EscapeCSVProcessor : replaces \" by "" in hope FasterCSV will be able to munge your CSV afterwards
  • CleanUpTransform : like AW-ETL DecodeTransform, but leave the original value if no match is found

RUNNING SPECS

rake spec

Note: you’ll need to gem install activewarehouse-etl and fastercsv

TO BE ADDED

  • chunk-splitters bulk load processor to cope with mysql timeouts on Windows

=> thibaut.barrere@gmail.com