Popular repositories

1. demo-bert demo-bert Public template

   Forked from bananaml/demo-bert

   This is a BERT large language model starter template from Banana.dev that allows on-demand serverless GPU inference.

   Python

2. AutoGPTQ AutoGPTQ Public

   Forked from AutoGPTQ/AutoGPTQ

   An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

   Python

3. potas-llama-v2-7B-chat potas-llama-v2-7B-chat Public template

   Forked from lucataco/potas-llama-v2-7B-chat

   Attempt at running llama v2 7B chat

   Python

4. clip-serverless-template clip-serverless-template Public

   Forked from bananaml/clip-serverless-template

   Python

5. dockerLLM dockerLLM Public

   Forked from TheBlokeAI/dockerLLM

   TheBloke's Dockerfiles

   Shell

6. text-generation-webui text-generation-webui Public

   Forked from oobabooga/text-generation-webui

   A Gradio web UI for Large Language Models. Supports transformers, GPTQ, llama.cpp (ggml/gguf), Llama models.

   Python