AISystem 主要是指AI系统，包括AI芯片、AI编译器、AI推理和训练框架等AI全栈底层技术

🚀 Awesome System for Machine Learning ⚡️ AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). 🍻 OSDI, NSDI, SIGCOMM, SoCC, MLSys, etc. 🗃️ Llama3, Mistral, etc. 🧑‍💻 Video Tutorials.

Quantized Attention that achieves speedups of 2.1-3.1x and 2.7-5.1x compared to FlashAttention2 and xformers, respectively, without lossing end-to-end metrics across various models.

[ICLR2025 Spotlight] SVDQuant: Absorbing Outliers by Low-Rank Components for 4-Bit Diffusion Models

A model compilation solution for various hardware

FedScale is a scalable and extensible open-source federated learning (FL) platform.

SpargeAttention: A training-free sparse attention that can accelerate any model inference.

Measure and optimize the energy consumption of your AI applications!

Machine Learning Framework for Operating Systems - Brings ML to Linux kernel

An acceleration library that supports arbitrary bit-width combinatorial quantization operations

A scalable & efficient active learning/data selection system for everyone.

The repository has collected a batch of noteworthy MLSys bloggers (Algorithms/Systems)

Distributed RL System for LLM Reasoning

📚FFPA(Split-D): Yet another Faster Flash Prefill Attention with O(1) GPU SRAM complexity for headdim > 256, ~2x↑🎉vs SDPA EA.

A ChatGPT(GPT-3.5) & GPT-4 Workload Trace to Optimize LLM Serving Systems

Optimal Sparse Decision Trees

Materials for my 2021 NYU class on NLP and ML Systems (Master of Engineering).

Federated Learning Systems Paper List

NAACL '24 (Best Demo Paper RunnerUp) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference

sensAI: ConvNets Decomposition via Class Parallelism for Fast Inference on Live Data