Skip to content

jnshubham/DataValidationToolUsingSpark

Repository files navigation

Data Validation Tool Using Spark

This is a small utility which leverages pyspark to compare data between two tables existing in two different databases.

SETUP on linux (cent OS)

To setup on linux run the make file with following commands

make setup

make initialize

make build

Now to run the ui

make run

port 5000 is exposed so head to 5000 on ur browser.

and to kill the container

make kill

Setup on windows

To launch on windows download java1.8 and python3.8 then pip all the the requirements under config folder

pip install -r config/requirements.txt

To launch the app just trigger the bat file run.bat

Preview of UI

image

image

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors