NumPy & SciPy for GPU

Safe rust wrapper around CUDA toolkit

Web interface for browsing, search and filtering recent arxiv submissions

A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API

An autoregressive character-level language model for making more things

DepthCrafter: Generating Consistent Long Depth Sequences for Open-world Videos

A Datacenter Scale Distributed Inference Serving Framework

Based on a true story

A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.

Blazingly fast LLM inference.

Unsupervised text tokenizer for Neural Network-based text generation.

Arena-Hard-Auto: An automatic LLM benchmark.

Convert Compute And Books Into Instruct-Tuning Datasets! Makes: QA, RP, Classifiers.

Interact, analyze and structure massive text, image, embedding, audio and video datasets

The simplest, fastest repository for training/finetuning medium-sized GPTs.

Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models.

Tensor library for machine learning

LLM inference in C/C++

On-device Neural Engine

lightweight, standalone C++ inference engine for Google's Gemma models.

🌐 The Internet OS! Free, Open-Source, and Self-Hostable.

Learn System Design concepts and prepare for interviews using free resources.

Browser extension which parses competitive programming problems

Toolkit for linearizing PDFs for LLM datasets/training

The Apache Kafka C/C++ library

peer-2-peer that just works

Font introspection, complex text shaping and glyph rendering.

Everything you need to build state-of-the-art foundation models, end-to-end.

A neovim lua plugin to help easily manage multiple terminal windows