Skip to content

Compare tables between databases, from high aggragated level to the lowest column level.

Notifications You must be signed in to change notification settings

NSIT-BIM/DataStageTNR

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

28 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

T_NR

DataStage assets to perform different levels of table comparison

Installation

Just deploy the lastest released isx file and configure jdbc drivers if necessary. Find all releases here: https://gitlab.com/nsitbim/satellites/dsplus/datastagetnr/-/releases And download the artifact.

Usage

All assets are deployed in the T_NR folder.

1- Edit the ParameterSet to declare all databases accordingly

2- Either run the jobs individually or from the sequence

Each job takes 2 arguments:

  • the table to compare
  • the reference to the ParameterSet

Limitations

This is not intendend to be performant. It is more a proof of concept.

LOBs and float are not handled well so they have to be dropped or converted (see job documentation for more information)

Contributing

Pull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.

Please make sure to update tests as appropriate.

Overview

https://nsitbim.grafana.net/d/V2SVuRBGz/datatage-project-overview?orgId=1&from=1611683142696&to=1611683275813&viewPanel=6

License

MIT

About

Compare tables between databases, from high aggragated level to the lowest column level.

Topics

Resources

Stars

Watchers

Forks

Packages

No packages published

Languages