Skip to content

Xuanwo/dlt-client

 
 

Repository files navigation

Client DLT is now e2e-Data. While the DLT library remains a core component, the rebrand avoids conflicts and reflects the platform’s expansion beyond data pipelines.

e2e-Data/DLT Client is an MVP Data Engineering project designed to build ETL pipelines through a web interface, using low/no-code features.

⚠️ Action required: As of Mar-08-2026, we've introduced LanceDB in the project as part of the Datacatalog implementation. Please refere to LanceDB setup or Environment re-run setup for this project, otherwise it might cause your pipeline not to run.

The front end is built using the Still.js framework and the Backend is built in dlt-hub (Python). This is a single repository comprising both the backend and the UI.

There is a live version deployed in the cloud as MVP2 release, you can access and test it using social login.

To learn how to set up your local dev environment, see development setup

See the ARCHITECTURE.md to follow the latest progress of the implementations.

To see some of e2e-Data's features in action, checkout the following videos:

  1. Creating a basic pipeline

  2. Scheduling a job for pipeline

  3. Pipeline versioning, Data transformation and File system sourceing

About

This is a Client for Managing dlt-hub (Data Load Tool) kind of Pipeline as well as handling queries through Duckdb

Resources

License

Code of conduct

Contributing

Stars

Watchers

Forks

Packages

 
 
 

Contributors

Languages

  • JavaScript 52.2%
  • Python 28.2%
  • HTML 12.1%
  • CSS 7.4%
  • Other 0.1%