WhereHows is a data discovery and lineage tool built at LinkedIn. It integrates with all the major data processing systems and collects both catalog and operational metadata from them. This README has been modified for ezCater's use.
Within the central metadata repository, WhereHows curates, associates, and surfaces the metadata information through two interfaces:
- a web application that enables data & linage discovery, and community collaboration
- an API endpoint that empowers automation of data processes/applications
WhereHows serves as the single platform that:
- links data objects with people and processes
- enables crowdsourcing for data knowledge
- provides data governance and provenance based on ownership and lineage
Here is a list of companies known to use WhereHows. Let us know if we missed your company!
How WhereHows is used inside of LinkedIn and other potential use cases.
The detailed information can be found in the Wiki
New to Wherehows? Check out the Getting Started Guide
Please download the Amazon RedshiftJDBCDriver42.jar(https://docs.aws.amazon.com/redshift/latest/mgmt/configure-jdbc-connection.html#download-jdbc-driver) file
Please download the gsp.jar for SQL Parsing(http://www.sqlparser.com/)
Put a these jar files to wherehows-etl/extralibs directory. See the download instrucitons for more detail. cd WhereHows/wherehows-etl/extralibs
Please download Docker(https://www.docker.com/community-edition#/download)
Docker can provide configuration free dev/production setup quickly, please check out more information in the Docker Getting Start Guide Locally, we perform these steps:
- Clone this repo
- In your Wherehows repo, cd to wherehows-docker
- run
./build.sh <DOCKER_CONTAINER_TAG> - run
docker-compose up - The WhereHows UI is available at http://localhost:9001 by default. You can change the port number by editing the value of
project.ext.httpPortinwherehows-frontend/build.gradle.
Check out the current roadmap for WhereHows.
Want to contribute? Check out the Contributors Guide
Want help? Check out the Gitter chat room and Google Groups