Skip to content
@xlite-dev

xlite-dev

Develop ML/AI toolkits and ML/AI/CUDA Learning resources.
README.md

Pinned Loading

  1. lite.ai.toolkit Public

    🛠 A lite C++ AI toolkit: 100+🎉 models (Stable-Diffusion, Face-Fusion, YOLO series, Det, Seg, Matting) with MNN, ORT and TRT.

    C++ 4k 739

  2. Awesome-LLM-Inference Public

    📚A curated list of Awesome LLM/VLM Inference Papers with codes: WINT8/4, FlashAttention, PagedAttention, MLA, Parallelism etc.

    Python 3.9k 275

  3. CUDA-Learn-Notes Public

    📚Modern CUDA Learn Notes: 200+ Tensor/CUDA Cores Kernels🎉, HGEMM, FA2 via MMA and CuTe, 98~100% TFLOPS of cuBLAS/FA2.

    Cuda 3.6k 393

  4. statistic-learning-R-note Public

    📒统计学习方法-李航: 笔记-从原理到实现, 200-page PDF Notes with detailed explanations of various math formulas, implemented in R.🎉

    445 55

  5. torchlm Public

    💎A high level pipeline for face landmarks detection: train, eval, inference (Python/C++) and 100+ data augmentations.

    Python 257 24

  6. ffpa-attn-mma Public

    📚FFPA(Split-D): Yet another Faster Flash Attention with O(1) GPU SRAM complexity large headdim, 1.8x~3x↑🎉 faster than SDPA EA.

    Cuda 171 7

Repositories

Showing 10 of 22 repositories
  • Awesome-LLM-Inference Public

    📚A curated list of Awesome LLM/VLM Inference Papers with codes: WINT8/4, FlashAttention, PagedAttention, MLA, Parallelism etc.

    Python 3,895 GPL-3.0 275 1 0 Updated Apr 25, 2025
  • Awesome-Diffusion-Inference Public

    📖A curated list of Awesome Diffusion Inference Papers with codes: Sampling, Caching, Multi-GPUs, etc. 🎉🎉

    213 GPL-3.0 13 0 0 Updated Apr 25, 2025
  • CUDA-Learn-Notes Public

    📚Modern CUDA Learn Notes: 200+ Tensor/CUDA Cores Kernels🎉, HGEMM, FA2 via MMA and CuTe, 98~100% TFLOPS of cuBLAS/FA2.

    Cuda 3,619 GPL-3.0 393 5 0 Updated Apr 22, 2025
  • lite.ai.toolkit Public

    🛠 A lite C++ AI toolkit: 100+🎉 models (Stable-Diffusion, Face-Fusion, YOLO series, Det, Seg, Matting) with MNN, ORT and TRT.

    C++ 4,046 GPL-3.0 739 1 0 Updated Apr 11, 2025
  • xlite-cli Public

    The cli version of lite.ai.toolkit

    C++ 1 0 0 0 Updated Apr 9, 2025
  • ffpa-attn-mma Public

    📚FFPA(Split-D): Yet another Faster Flash Attention with O(1) GPU SRAM complexity large headdim, 1.8x~3x↑🎉 faster than SDPA EA.

    Cuda 171 GPL-3.0 7 2 0 Updated Apr 6, 2025
  • hgemm-tensorcores-mma Public

    ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.

    Cuda 73 GPL-3.0 3 0 0 Updated Mar 30, 2025
  • .github Public
    1 0 0 0 Updated Mar 30, 2025
  • SageAttention Public Forked from thu-ml/SageAttention

    Quantized Attention that achieves speedups of 2.1-3.1x and 2.7-5.1x compared to FlashAttention2 and xformers, respectively, without lossing end-to-end metrics across various models.

    Cuda 0 Apache-2.0 98 0 0 Updated Mar 23, 2025
  • flashinfer Public Forked from flashinfer-ai/flashinfer

    FlashInfer: Kernel Library for LLM Serving

    Cuda 0 Apache-2.0 287 0 0 Updated Mar 23, 2025
View all repositories

Most used topics

Loading…