LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
-
Updated
Nov 18, 2024 - Python
#
openai-triton
Here are 5 public repositories matching this topic...
Best inference performance optimization framework for HuggingFace Diffusers on NVIDIA GPUs.
cuda
torch
pytorch
inference-engines
performance-optimizations
stable-diffusion
diffusers
deeplearnng
openai-triton
stable-video-diffusion
-
Updated
Jul 16, 2024 - Python
A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.
-
Updated
Oct 25, 2024 - Python
Training-free Post-training Efficient Sub-quadratic Complexity Attention. Implemented with OpenAI Triton.
-
Updated
Nov 5, 2024 - Python
Improve this page
Add a description, image, and links to the openai-triton topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the openai-triton topic, visit your repo's landing page and select "manage topics."