Home

Welcome to the Versaile Data Kit wiki!

Versatile Data Kit (VDK) is a data framework that enables Data Engineers to

🧑‍💻 develop,
▶️ run,
📊 and manage data workloads, aka data jobs

What Problem Does Versatile Data Kit Solve?

• Ingest data from different sources.
• Use Python/SQL and VDK templates to transform data.
• Package, version, and deploy data applications while dealing with credentials, retries, and reconnects.
• Provide built-in monitoring and smart notification capabilities.
• Track code and data modifications for quicker troubleshooting and version rollback.

➡️ To Get Started

• Getting Started
• Installation
• First Data Job
• Examples
• Dictionary

➡️ What you can do with Versatile Data Kit - User Guide

• Overview
• VDK Components
• Installation
• Data Job Types
• Data Job Structure
• Python steps (.py)
• Ingesting data
• Data Job Properties
• Data Job Configuration
• Python dependencies (requirements.txt)
• Data Job Execution
• Resiliency
• Data Jobs Development Workflow

➡️ Our community meeting notes can be found here: Go to Community Meetings

- Community meeting Youtube playlist

Our community meeting notes can be found here:
➡️ Go to Community Meetings

All the resources / tutorials / videos about VDK:
➡️ Go to Resources

If you are a developer of Versatile Data Kit:
➡️ Go to Dev Guide

If you are writing documentation for Versatile Data Kit:
➡️ Go to Documentation Guide