Knowledge Vault

This is one place where you can find my notes for my study. Some of these are used to publish my blogs and papers.

Model Architectures

• ResNet50
• AlexNet
• DeepSeek-V3
• Kimi K3 — SGLang implementation breakdown: hybrid KDA/MLA attention, latent MoE, attention-residual bank, fused collectives

Tools

Papers

• Prefill as a service - Cross datacenter KV cache

Study Materials

GPU Programming Concepts

• GPU Concpets - SharedMemory