Skip to content
@xlite-dev

xlite-dev

Develop ML/AI toolkits and ML/AI/CUDA Learning resources.
README.md

Pinned Loading

  1. lite.ai.toolkit Public

    🛠 A lite C++ toolkit: Deploy 100+ AI models (Stable-Diffusion, Face-Fusion, YOLO series, Det, Seg, etc) via MNN, ORT and TRT. 🎉🎉

    C++ 4k 737

  2. Awesome-LLM-Inference Public

    📖A curated list of Awesome LLM/VLM Inference Papers with codes: WINT8/4, FlashAttention, PagedAttention, MLA, Parallelism etc. 🎉🎉

    Python 3.8k 265

  3. CUDA-Learn-Notes Public

    📚Modern CUDA Learn Notes: 200+ Tensor/CUDA Cores Kernels, FA2, HGEMM via MMA and CuTe (~99% TFLOPS of cuBLAS/FA2 🎉).

    Cuda 3.2k 337

  4. statistic-learning-R-note Public

    📒统计学习方法-李航: 笔记-从原理到实现, 200-page PDF Notes with detailed explanations of various math formulas, implemented in R.🎉

    444 55

  5. torchlm Public

    💎A high level pipeline for face landmarks detection: train, eval, inference (Python/C++) and 100+ data augmentations.

    Python 255 24

  6. ffpa-attn-mma Public

    📚FFPA(Split-D): Yet another Faster Flash Prefill Attention with O(1) SRAM complexity large headdim (D > 256), ~2x↑🎉vs SDPA EA.

    Cuda 158 7

Repositories

Showing 10 of 22 repositories
  • xlite-cli Public

    The cli version of lite.ai.toolkit

    C++ 0 0 0 0 Updated Apr 1, 2025
  • CUDA-Learn-Notes Public

    📚Modern CUDA Learn Notes: 200+ Tensor/CUDA Cores Kernels, FA2, HGEMM via MMA and CuTe (~99% TFLOPS of cuBLAS/FA2 🎉).

    Cuda 3,164 GPL-3.0 337 6 0 Updated Apr 1, 2025
  • Awesome-LLM-Inference Public

    📖A curated list of Awesome LLM/VLM Inference Papers with codes: WINT8/4, FlashAttention, PagedAttention, MLA, Parallelism etc. 🎉🎉

    Python 3,769 GPL-3.0 265 0 0 Updated Mar 31, 2025
  • hgemm-tensorcores-mma Public

    ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.

    Cuda 65 GPL-3.0 3 0 0 Updated Mar 30, 2025
  • .github Public
    1 0 0 0 Updated Mar 30, 2025
  • lite.ai.toolkit Public

    🛠 A lite C++ toolkit: Deploy 100+ AI models (Stable-Diffusion, Face-Fusion, YOLO series, Det, Seg, etc) via MNN, ORT and TRT. 🎉🎉

    C++ 4,009 GPL-3.0 737 0 0 Updated Mar 29, 2025
  • ffpa-attn-mma Public

    📚FFPA(Split-D): Yet another Faster Flash Prefill Attention with O(1) SRAM complexity large headdim (D > 256), ~2x↑🎉vs SDPA EA.

    Cuda 158 GPL-3.0 7 2 0 Updated Mar 25, 2025
  • Awesome-Diffusion-Inference Public

    📖A curated list of Awesome Diffusion Inference Papers with codes: Sampling, Caching, Multi-GPUs, etc. 🎉🎉

    204 GPL-3.0 13 0 0 Updated Mar 23, 2025
  • SageAttention Public Forked from thu-ml/SageAttention

    Quantized Attention that achieves speedups of 2.1-3.1x and 2.7-5.1x compared to FlashAttention2 and xformers, respectively, without lossing end-to-end metrics across various models.

    Cuda 0 Apache-2.0 87 0 0 Updated Mar 23, 2025
  • flashinfer Public Forked from flashinfer-ai/flashinfer

    FlashInfer: Kernel Library for LLM Serving

    Cuda 0 Apache-2.0 266 0 0 Updated Mar 23, 2025
View all repositories

Top languages

Loading…