GPU Kernel Engineering — First Edition

PDF edition of the blog.

A free e-book on GPU kernel engineering for NVIDIA Blackwell data-center GPUs (B200), in CUDA/PTX. Learn memory layouts, pipelining, and other performance optimizations through a step by step walkthrough from a simple attention kernel to a highly optimized implementation.

Includes illustrated explanations, code walkthroughs, and a video-generation capstone project.

Download gpu-kernel-engineering.pdf from the Assets section below.