Machine Learning Engineering Open Book
-
Updated
Jun 6, 2024 - Python
Machine Learning Engineering Open Book
A scalable, efficient, cross-platform (Linux/macOS) and easy-to-use workflow engine in pure Python.
Simplify HPC and Batch workloads on Azure
TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.
Slurm-Mail is a drop in replacement for Slurm's e-mails to give users much more information about their jobs compared to the standard Slurm e-mails.
SEML: Slurm Experiment Management Library
☁️ Export Ploomber pipelines to Kubernetes (Argo), Airflow, AWS Batch, SLURM, and Kubeflow.
qtop (pronounced queue-top) is a tool written in order to monitor the state of Queueing Systems, along with related information relevant on HPC & grid clusters. At present it supports **PBS, SGE & OAR** families. There is a historic reference for the prior shell version of the tool, at former CERN source:
Deprecated see https://github.com/MHH-RCUG/nf_wochenende : A whole Genome/Metagenome Sequencing Alignment Pipeline in Python3
Singularity recipe for AlphaFold
launching and controlling spark on hpc clusters
A toolset for black-box hyperparameter optimisation.
Add a description, image, and links to the slurm topic page so that developers can more easily learn about it.
To associate your repository with the slurm topic, visit your repo's landing page and select "manage topics."