Inference

Domain specific architectures for AI inference
https://fleetwood.dev/posts/domain-specific-architectures

A TensorRT Toolbox for Optimized Large Language Model Inference
https://github.com/NVIDIA/TensorRT-LLM

Fast LLM Inference From Scratch
https://andrewkchan.dev/posts/yalm.html#section-3.5