TinyAGI is a lightweight, modular, and extensible Python-based AGI framework designed to create and manage AI agents seamlessly. It supports various model backends like OpenAI, Llama.cpp, Ollama, AlpacaX, and Tabitha, along with dynamic plugin loading for enhanced flexibility.

Experimental interface environment for LLM, designed to democratize the use of open source AI. Powered by llama-cpp, llama-cpp-python and Gradio.

Self-evaluating interview for AI coders

My website

Python script-supervisor iteratively executes script-agent and modifies it via LLM that is instructed with description of supervisor functioning and final goal, then at each iteration gets retval, stdout, stderr of current agent, and is asked to reply with next agent verbatim. Optional jailbreak attempt. TUI. Unsafe.

Generate images for articles, blogs, and publications using NLP, Segmind API, Blip captioning and Llama.Cpp

Serverless generative AI with llama.cpp on AWS Lambda.

Local character AI chatbot with chroma vector store memory and some scripts to process documents for Chroma

An AI-powered, but model-agnostic (Optical-Character-Recognition) OCR tool

Langport is a language model inference service

An interactive AI platform with both terminal and web-based interfaces for real-time model interactions, featuring dynamic model integration and immediate feedback streaming. Developed by *The Vanguards*.

This repo is to showcase how you can run a model locally and offline, free of OpenAI dependencies.

a very basic example to start working with LLM using llama and Mistral 7B, or to use as it as a local assistant

Local llama provider for gptscript

A Genshin Impact Question Answer Project supported by Qwen1.5-14B-Chat

Genshin Impact Character Chat Models tuned by Lora on LLM

AgentX is an Open-source library that help people use LLMs on their own computers or help them to serve LLMs as easy as possible that support multi-backends like PyTorch, llama.cpp, Ollama and EasyDeL

llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deployment, such as UI, RESTful API, auto-scaling, computing resource management, monitoring, and more.

Powering Agent Chains by Constraining LLM Outputs

📚 Local PDF-Integrated Chat Bot: Secure Conversations and Document Assistance with LLM-Powered Privacy