Blogs

Diffusion will be everywhere
https://varunneal.github.io/essays/diffusion

The Transformers
https://www.vizuaranewsletter.com/p/the-transformers

SFT, RL, and On-Policy Distillation Through a Distributional Lens
https://nrehiew.github.io/blog/sft_rl_opd/

Quantization from the ground up
https://ngrok.com/blog/quantization

KV Cache Compression and Its Infra Problems
https://research.nvidia.com/labs/eai/blogs/kv-cache-compression-and-its-infra-problems/

A Hitchhiker’s Guide to ML Training Infrastructure
https://www.sei.cmu.edu/blog/a-hitchhikers-guide-to-ml-training-infrastructure/

Inside the Transformer: The Life of a Token
https://www.aleksagordic.com/blog/transformer

An Intuitive Introduction to Flow-Based Language Generation
https://flow-based-llms.github.io/

Reinforcement Learning from Human Feedback
https://arxiv.org/abs/2504.12501

Optimizers and ODEs
https://jiha-kim.github.io/posts/optimizers-and-odes/

JAX-LM: Language Modelling and Distributed Training in JAX
https://www.chuyishang.com/blog/2026/jax-lm/

Ziming Liu's Blog
https://kindxiaoming.github.io/blog/

The DNA of a Transformer
https://vizuaraai.github.io/dna-of-a-transformer/

Everything About Transformers
https://www.krupadave.com/articles/everything-about-transformers?x=v3

The Need For Speed: KV Cache and memory optimization at Inference
https://vectorsandverbs.com/posts/kv-cache/

Optimizing diffusion inference for production-ready speeds - I
https://a-r-r-o-w.github.io/blog/3_blossom/00001_productionizing_diffusion-1

A Gradient-Level Look at PPO/GRPO and CISPO
https://yumoxu.notion.site/a-gradient-level-look-at-ppo-grpo-and-cispo

A short note on optimizing NNs
https://fracapuano.github.io/blog/optimizing-nns

Understanding attention
https://mbernste.github.io/posts/attention/

Can Transformers Do Everything, and Undo It Too?
https://astro-eric.github.io/blogs/surjective/

How Long Contexts Fail
https://www.dbreunig.com/2025/06/22/how-contexts-fail-and-how-to-fix-them.html

Agentic software is just software 04 Jun 2025
https://www.livinginthepast.org/blog/agents/

Agent Labs Are Eating the Software World
https://www.nibzard.com/agent-labs

Agent Engineering 101
https://www.ashpreetbedi.com/articles/agent-engineering

Intro to Quantization in LLMs
https://medium.com/@prathamgrover777/intro-to-quantization-in-llms-adfae03bf447

Claude Agent Skills: A First Principles Deep Dive
https://leehanchung.github.io/blogs/2025/10/26/claude-skills-deep-dive

PyTorch internals
https://blog.ezyang.com/2019/05/pytorch-internals/