GUI for GGML Alpaca models

My AI Assistant is an open source virtual assistant chatbot built with Python. It allows you to have natural conversations by text or voice.

Some random tools for working with the GGUF file format

Auto Complete anything using a gguf model

convert a saved pytorch model to gguf and generate as much corresponding ggml c code as possible

Cost-effective AI Microservice System

GGUF parser for Go

glai - GGUF LLAMA AI - Package for simplified model handling and text generation with Llama models quantized to GGUF format. APIs for downloading and loading models automatically, includes a db with models of various scale and quantizations. With this high level API you need one line to load the model and one to generate text completions.

Wrapper for simplified use of Llama2 GGUF quantized models.

Chat Generative Pre-trained Transformer

A collection of cog models for use on Replicate

Terminal UI for locally hosted large language models

Finetuning the Mistral7b on custom dataset

print_gguf.py is a simple utility to parse the header & tensor_infos of GGUF file.

chat Generative Pre-trained Transformer model selector

a GGUF file parser

solo connector core built on ctransformers

Making offline AI models accessible to all types of edge devices.

GGUF caller

GGUF selector