Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

Python bindings for MPI

Zero-copy MPI communication of JAX arrays, for turbo-charged HPC applications in Python ⚡

Python extension language using accelerators

Distributed and decentralized training framework for PyTorch over graph

Best practices & guides on how to write distributed pytorch training code

Simplify HPC and Batch workloads on Azure

DeepHyper: Scalable Asynchronous Neural Architecture and Hyperparameter Search for Deep Neural Networks

A fast poisson image editing implementation that can utilize multi-core CPU or GPU to handle a high-resolution image input.

Distributed tensors and Machine Learning framework with GPU and MPI acceleration in Python

FedTorch is a generic repository for benchmarking different federated and distributed learning algorithms using PyTorch Distributed API.

A common interface to processing pools.

Analysis kit for large-scale structure datasets, the massively parallel way

Geophysical Bayesian Inference in Python. Docs:

OpenClimateGIS is a set of geoprocessing and calculation tools for CF-compliant climate datasets.

DISROPT: A Python framework for distributed optimization

Efficient and scalable parallelism using the message passing interface (MPI) to handle big data and highly computational problems.

Code for tutorials and examples

Official Code of "[ICCV 2023] MPI-Flow: Learning Realistic Optical Flow with Multiplane Images"

Evolution Strategy Library