Genome modeling and design across all domains of life

Small scale distributed training of sequential deep learning models, built on Numpy and MPI.

common in-memory tensor structure

Mirage: Automatically Generating Fast GPU Kernels without Programming in Triton/CUDA

The n-gram Language Model

TUI for the Slurm Workload Manager

simple bibtex generator for any text with \cite{}

High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.

A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.

Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verified research papers.

Arena-Hard-Auto: An automatic LLM benchmark.

A MAD laboratory to improve AI architecture designs 🧪

Official repo for "Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models"

Neighborhood Attention Extension. Bringing attention to a neighborhood near you!

Finetune Llama 3.3, DeepSeek-R1, Gemma 3 & Reasoning LLMs 2x faster with 70% less memory! 🦥

Large Context Attention

[ICML 2024 Best Paper] Discrete Diffusion Modeling by Estimating the Ratios of the Data Distribution (https://arxiv.org/abs/2310.16834)

Biological foundation modeling from molecular to genome scale

Memray is a memory profiler for Python

A family of lightweight multimodal models.

FlashInfer: Kernel Library for LLM Serving

Minimalistic large language model 3D-parallelism training

The Art of Debugging

Tool for data extraction and interacting with Lean programmatically.

The Truth Is In There: Improving Reasoning in Language Models with Layer-Selective Rank Reduction

Tools for merging pretrained large language models.

This repository contains the official implementation of the research paper, "FastViT: A Fast Hybrid Vision Transformer using Structural Reparameterization" ICCV 2023

Yet Another Python Profiler, but this time multithreading, asyncio and gevent aware.

Curate better data for LLMs