Popular repositories Loading

1. unified_docker_benchmark_public unified_docker_benchmark_public Public

   Shell 3

2. llm_tflops_simulator llm_tflops_simulator Public

   Python 1

3. AutoAWQ AutoAWQ Public

   Forked from casper-hansen/AutoAWQ

   AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference.

   Python

4. AutoGPTQ AutoGPTQ Public

   Forked from AutoGPTQ/AutoGPTQ

   ROCM6.0

   Python

5. cyclecloud_tgi cyclecloud_tgi Public

   Shell

6. llm_inference_DLM llm_inference_DLM Public

   Python 1