Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
-
Updated
Sep 21, 2024 - Python
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
Sacred is a tool to help you configure, organize, log and reproduce experiments developed at IDSIA.
pyinfra turns Python code into shell commands and runs them on your servers. Execute ad-hoc commands and write declarative operations. Target SSH servers, local machine and Docker containers. Fast and scales from one server to thousands.
Accelerated deep learning R&D
Distributed self-replicating programs in Python
An open, distributed platform as a service
Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.
Build better AWS infrastructure
a lightweight, security focused, BDD test framework against terraform.
A Data Engineering & Machine Learning Knowledge Hub
Dispatch and distribute your ML training to "serverless" clusters in Python, like PyTorch for ML infra. Iterable, debuggable, multi-cloud/on-prem, identical across research and production.
🎨 Infinite Drawboard in Python
The next generation of Infrastructure-as-Code. Work with high-level constructs instead of getting lost in low-level cloud configuration.
Using network observability to operate and design healthier networks
python wrapper for Proxmox API v2 (https://pve.proxmox.com/pve-docs/api-viewer/index.html)
Command Line Interface for Oracle Cloud Infrastructure
The official Linode command line interface.
Infrastructure to set up the public Compiler Explorer instances and compilers
Dell OpenManage Ansible Modules
📦 CodeBox is the simplest cloud infrastructure for your LLM Apps and Services.
Add a description, image, and links to the infrastructure topic page so that developers can more easily learn about it.
To associate your repository with the infrastructure topic, visit your repo's landing page and select "manage topics."