Skip to content

Azure/mirror-lake-kusto

Repository files navigation

Mirror Lake Kusto

Lake

Continuous Build / Unit Test Integration tests

Mirror Lake Kusto is a Command Line Interface (CLI) tool allowing you to keep an Apache Delta Lake table and a Kusto Table in sync so the Kusto table becomes a mirror of the Delta table.

There are many options and authentication methods, but a straightforward example is:

mirror-lake-kusto -s <Delta Table ADLS folder URL> -k <Kusto Cluster Query URL> -d <Kusto DB> -t <Kusto Table> -c <Checkpoint ADLS folder URL>

The CLI will keep the two tables in sync by ingesting and deleting data in Kusto. No duplication, no data loss.

About

POC for mirroring external tables, starting with Delta Lake tables.

Resources

License

Code of conduct

Security policy

Stars

Watchers

Forks

Packages

No packages published