You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Handwritten Qwen2.5-0.5B inference engine — no vLLM, no model.generate(); CUDA Graph + hand-written Triton flash kernels, 3.34x vLLM decode TPS on a single RTX 2080 Ti (96.15/100). Independent work…