Some common CUDA kernel implementations (Not the fastest).
-
Updated
Aug 14, 2024 - Cuda
Some common CUDA kernel implementations (Not the fastest).
🎉CUDA/C++ 笔记 / 大模型手撕CUDA / 技术博客,更新随缘: flash_attn、sgemm、sgemv、warp reduce、block reduce、dot product、elementwise、softmax、layernorm、rmsnorm、hist etc.
Add a description, image, and links to the softmax topic page so that developers can more easily learn about it.
To associate your repository with the softmax topic, visit your repo's landing page and select "manage topics."