A generalized information-seeking agent system with Large Language Models (LLMs).

Run MemGPT-AutoGEN-Local LLM Together

[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization

KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization

MVP of an idea using multiple local LLM models to simulate and play D&D

Slack bot that integrates local LLM into your workflows

Humanlike AI Chat is a terminal-based LLM UI designed to study how to bypass AI text detection.

Local AI Search assistant web or CLI for ollama and llama.cpp. Lightweight and easy to run, providing a Perplexity-like experience.

This project is a multi-agent security framework that utilizes multiple LLM models to analyze and generate comprehensive security briefs.

Local AI Open Orca For Dummies is a user-friendly guide to running Large Language Models locally. Simplify your AI journey with easy-to-follow instructions and minimal setup. Perfect for developers tired of complex processes!

Tiny Starcoder LLM Implementation, added to commands

This is a basic workflow with CrewAI agents working with sales transactions to draw business insights and marketing recommendations. The agents will work on everything from the execution plan to the business insights report. It works with local LLM via Ollama (I'm using llama3:8B but you can easily change it).

Read your local files and answer your queries

This started out as a POC for chatting over my documents, but has turned into a whole framework for using LLMs.

A library that manages tools (functions) for Local LLMs

A clone of InfiniteCraft (AI!!! LLMs!!) you can run on a laptop _without_ a good GPU!!

ScrAIbe Assistant is designed to leverage Whisper for precise audio processing and local LLMs via Ollama for efficient summarization. This tool is perfect for tasks such as taking notes from team meetings or lectures, offering a secure environment where no data—be it text, audio, or otherwise—leaves your local machine.

BgGPT for Jan 👋