Deploy Dask on job schedulers like PBS, SLURM, and SGE
-
Updated
Jun 17, 2024 - Python
Deploy Dask on job schedulers like PBS, SLURM, and SGE
qtop (pronounced queue-top) is a tool written in order to monitor the state of Queueing Systems, along with related information relevant on HPC & grid clusters. At present it supports **PBS, SGE & OAR** families. There is a historic reference for the prior shell version of the tool, at former CERN source:
A Slurm dashboard for the terminal.
Submit functions and shell scripts to torque and slurm clusters or local machines using python.
Submit slurm cluster job(Sbatch) inside python and avoid shell script. Submission cmd can be customized to add more options.
Efficient Datamodules Customized for the Mila / CC clusters
asyncmd is a library to write concurrent code for setup, run and analysis of molecular dynamics simulations using pythons async/await synthax.
This workflow performs a metatranscriptomics and bulk RNAseq analysis from the sequencing output data to the differential expression analyses.
A Python package to manage protein design workflows on computing clusters and local machines. Documentation can be found here: https://protflow.readthedocs.io/en/latest/
Not the slurm job dispatcher you need, but the one you deserve.
Generic Snakemake profile to set up SLURM integration
Generalized submit command for slurm / moabs
Basically all ingredients for building HPC style clusters are here.
A small helper tool to manage SLURM job creation / submission in a more pythonic way.
Slurm job submission in Python
LaunchPad is a light-weighted Slurm job launcher designed for hyper-parameter search.
A simple tool to perform parameter sweeps on SLURM clusters.
Common functions and infrastructure built during my phd projects
Add a description, image, and links to the slurm-cluster topic page so that developers can more easily learn about it.
To associate your repository with the slurm-cluster topic, visit your repo's landing page and select "manage topics."