Accelerate PyTorch models with ONNX Runtime

Toolbox of models, callbacks, and datasets for AI/ML researchers.

Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.

Sparse Submanifold CNN for Neutrino Telescopes

Official codebase for I-JEPA, the Image-based Joint-Embedding Predictive Architecture. First outlined in the CVPR paper, "Self-supervised learning from images with a joint-embedding predictive arch…

Mamba SSM architecture

GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection

A repository for research on medium sized language models.

The simplest, fastest repository for training/finetuning medium-sized GPTs.

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

The best ChatGPT that $100 can buy.