A generalized information-seeking agent system with Large Language Models (LLMs).

[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization

[NeurIPS 2024] KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization

Run MemGPT-AutoGEN-Local LLM Together

MVP of an idea using multiple local LLM models to simulate and play D&D

Unofficial entropix impl for Gemma2 and Llama and Qwen2 and Mistral

A local chatbot for managing docs

Humanlike AI Chat is a terminal-based LLM UI designed to study how to bypass AI text detection.

This started out as a POC for chatting over my documents, but has turned into a whole framework for using LLMs.

This project is a multi-agent security framework that utilizes multiple LLM models to analyze and generate comprehensive security briefs.

A german workshop where you learn how to build RAGs with Langchain

A library that manages tools (functions) for Local LLMs

Read your local files and answer your queries

Local AI Open Orca For Dummies is a user-friendly guide to running Large Language Models locally. Simplify your AI journey with easy-to-follow instructions and minimal setup. Perfect for developers tired of complex processes!

BgGPT for Jan 👋

A minimal CLI tool to locally summarize any text using LLM!

Slack bot that integrates local LLM into your workflows

This is a basic workflow with CrewAI agents working with sales transactions to draw business insights and marketing recommendations. The agents will work on everything from the execution plan to the business insights report. It works with local LLM via Ollama (I'm using llama3:8B but you can easily change it).

Tiny Starcoder LLM Implementation, added to commands

This repository contains a Python-based tool for summarizing web content using the Ollama API. It scrapes articles from URLs, cleans and processes the HTML content, and generates summaries using a pre-trained language model. The repository also includes a rich-based logging utility for improved console output.