Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

Excalidraw app for mac. Powered by pure SwiftUI.

Building LLMs from scratch following the book from S. Raschka

Named Entity Recognition with an decoder-only (autoregressive) LLM using HuggingFace

Command line program to validate and convert CITATION.cff files.

A general fine-tuning kit geared toward diffusion models.

CLI/GUI for managing the battery charging status for Apple silicon (M1, M32, M3) Macs

Machine Learning Journal for Intermediate to Advanced Topics.

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

Finetune a pre-trained GPT-2 model to generate personalized product recommendations for users, based on product reviews and metadata

Learn ML fundamentals for free.

A reactive notebook for Python — run reproducible experiments, query with SQL, execute as a script, deploy as an app, and version with git. All in a modern, AI-native editor.

AI Observability & Evaluation

Thunder gives you PyTorch models superpowers for training and inference. Unlock out-of-the-box optimizations for performance, memory and parallelism, or roll out your own.

Material for gpu-mode lectures

Implementation of DoRA

Reference implementation for DPO (Direct Preference Optimization)

Machine Learning Engineering Open Book

Full Stack Graph Machine Learning: Theory, Practice, Tools and Techniques

Distributed Reinforcement Learning accelerated by Lightning Fabric

NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day

Scientific Python Library Development Guide and Cookiecutter

Large Language Models for All, 🦙 Cult and More, Stay in touch !

Fast & Simple repository for pre-training and fine-tuning T5-style models

Train to 94% on CIFAR-10 in <6.3 seconds on a single A100. Or ~95.79% in ~110 seconds (or less!)

Advanced AI Explainability for computer vision. Support for CNNs, Vision Transformers, Classification, Object detection, Segmentation, Image similarity and more.

Lightning HPO & Training Studio App

Run ruff, isort, pyupgrade, mypy, pylint, flake8, and more on Jupyter Notebooks

A standard framework for modelling Deep Learning Models for tabular data