Metadata Driven DW Automation v1.09

@Roenbaeck Roenbaeck released this Apr 26, 2016 · 2 commits to ETL since this release

Primarily fixes a number of bugs, but also adds new features. When jobs are recreated by the installation process, any schedules on the job will now remain. A simple application that displays a loading report has been added. A function that converts UTC to local time has been added to the .NET CLR assembly. A new and improved splitter (with respect to performance) has also been added. This release is fully backwards compatible and can be dropped in as a replacement for version 1.08.

Downloads

Metadata Driven DW Automation v1.08

@Roenbaeck Roenbaeck released this Sep 8, 2015 · 31 commits to ETL since this release

Fixes a few annoyances, such as directories being changed when calling the bat-files. Added some preliminary support for SQL Server 2005. There is a video tutorial available on how to use the framework here: https://www.youtube.com/playlist?list=PLG6-3kKEOyYlWEaEFzhcARtjqHU6zn1cH

Downloads

Metadata Driven DW Automation v1.07

@Roenbaeck Roenbaeck released this Aug 15, 2015 · 36 commits to ETL since this release

This release fixes a couple of bugs that prevented the Example from running properly on all versions of Windows. It also adds support for quoted terminators, which can be specified through delimiter="","" for example.

Downloads

Metadata Driven DW Automation v1.06

@Roenbaeck Roenbaeck released this May 25, 2015 · 37 commits to ETL since this release

This release separates the framework from the projects on which it operates, making it much easier to upgrade existing framework installations. Key and type checking can now be optionally controlled from the source XML description. BULK splitting has been improved and support for FIRSTROW has been added (in order to skip headers). A number of bug fixes have been included. Among them the important one which fixes the problem of upper case data types not being checked at all.

Downloads

Metadata Driven DW Automation v1.05

@Roenbaeck Roenbaeck released this Feb 4, 2015 · 50 commits to ETL since this release

This release fixes the example files (vehicle collisions in Manhattan). GitHub were treating them as source code files and thereby felt at liberty to modify them, unfortunately making them unreadable. They are now marked as binary, which means GitHub is no longer able to touch them when they are checked in or out.

Downloads

Metadata Driven DW Automation v1.04

@Roenbaeck Roenbaeck released this Oct 28, 2014 · 63 commits to ETL since this release

The TRY_CAST has been replaced by a CLR function that correctly detects truncation of types. It also removes the dependency on being on SQL Server 2012 or later. The framework should now work just as well in 2005/2008.
Some other features have also been added, such as pre- and post processing in the target stored procedures, specified rowlength instead of varchar(max) in the Raw table, and a rewritten Splitter in C# that has slightly better performance than the old one.

Downloads

Metadata Driven DW Automation v1.03

@Roenbaeck Roenbaeck released this Oct 20, 2014 · 74 commits to ETL since this release

Fixed yet another missing metadatabase reference that prevented the metadatabase to be different from the staging database.

Downloads

Metadata Driven DW Automation v1.02

@Roenbaeck Roenbaeck released this Oct 20, 2014 · 75 commits to ETL since this release

This release fixes two bugs. Spaces can now be used in the filename directory path and BULK INSERT will no longer time out after 30 seconds when loading large files.

Downloads

Metadata Driven DW Automation v1.01

@Roenbaeck Roenbaeck released this Oct 20, 2014 · 77 commits to ETL since this release

This release fixes the bug which prevented the metadatabase to be different from the stage database.

Downloads

Metadata Driven DW Automation v1.0

@Roenbaeck Roenbaeck released this Oct 15, 2014 · 78 commits to ETL since this release

This is the first release of the medatadata driven data warehouse automation framework based on sisula and geared towards Anchor Modeling. The framework requires JScript by Windows Scripting Host in order to generate SQL code, which is executable on SQL Server 2012 or later. Once the code has been executed the SQL Server Agent will contain a number of jobs that drive the ETL flow through stored procedures generated from the metadata. Logging is made to an included metadata model which also ties in to the sys tables used by the SQL Server Agent.

Downloads