Popular repositories Loading

1. awesome-sysadmin awesome-sysadmin Public

   Forked from awesome-foss/awesome-sysadmin

   A curated list of amazingly awesome open-source sysadmin resources.

2. LLM-Prompt-Library LLM-Prompt-Library Public

   Forked from abilzerian/LLM-Prompt-Library

   Advanced Code and Text Manipulation Prompts for Various LLMs. Suitable for Siri, GPT-4o, Claude, Llama3, Gemini, and other high-performance open-source LLMs.

3. exllamav2 exllamav2 Public

   Forked from turboderp-org/exllamav2

   A fast inference library for running LLMs locally on modern consumer-class GPUs

   Python

4. SillyTavern-Extras SillyTavern-Extras Public

   Forked from SillyTavern/SillyTavern-Extras

   Extensions API for SillyTavern.

   Python

5. TensorRT-LLM TensorRT-LLM Public

   Forked from NVIDIA/TensorRT-LLM

   TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

   C++

6. AutoAWQ-torch-2.4 AutoAWQ-torch-2.4 Public

   Forked from casper-hansen/AutoAWQ

   AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:

   Python