TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.
-
Updated
May 30, 2024 - Python
TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.
🧙 Build, run, and manage data pipelines for integrating and transforming data.
Lightweight function pipeline (DAG) creation in pure Python for scientific workflows 🕸️🧪
ZenML 🙏: Build portable, production-ready MLOps pipelines. https://zenml.io.
Tekton library for EDP pipelines. EDP Interceptor that enriches payload from VCS with EDP entities
Turns Data and AI algorithms into production-ready web applications in no time.
LSST Data Management: base classes for data processing tasks
Pythonic tool for orchestrating machine-learning/high performance/quantum-computing workflows in heterogeneous compute environments.
Configuration interface and history-tracking for LSST Data Management.
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
MTAP: A framework for distributed text analysis using gRPC and microservices-based architecture.
A framework to manage data, continuously
DevOps tools
Django REST framework views using the pipeline pattern
Azure DevOps Extension for Azure CLI
Functional composable pipelines allowing clean separation of the business logic and its implementation
The easiest way to use Machine Learning. Mix and match underlying ML libraries and data set sources. Generate new datasets or modify existing ones with ease.
A PipelineTask execution framework for multi-node processing for the LSST Batch Production Service (BPS).
Add a description, image, and links to the pipelines topic page so that developers can more easily learn about it.
To associate your repository with the pipelines topic, visit your repo's landing page and select "manage topics."