The idea is to make an api that everyone can consume in their GPT4-like applications but with free models, to democratize its use.

Nino is a CLI tool that interacts with local language models via Ollama's serve mode, enabling real-time responses and easy output saving directly from the terminal.

Terminal UI for locally hosted large language models

[READ-ONLY] Stupid simple CLI tool that converts the content of a directory into context for LLMs.

A simple tool to query LLMs from the terminal

Prepare Git Commit Message with AI: Write commit message based on code changes with AI.

go binding for llama.cpp, offer low level and high level api

A minimalist LLM client that follows unix philosophy

Call many AIs from a single API.

Inference Llama 2 in one file of pure go

Port of Facebook's LLaMA 2 model in pure go and use little memory

Deliver LLMs of GGUF format via Dockerfile.

Create an IRC chat bot powered by AI, using llamafile, in minutes.

A client/server for LLaMA (Large Language Model Meta AI) that can run ANYWHERE.

privategpt implemented with Go

OpenShield is a new generation security layer for AI models

MaK(Mac+Kubernetes)llama - Running and orchestrating large language models (LLMs) on Kubernetes with macOS nodes.

soulshack, an irc chatbot. openai/ollama api compatible. easy shell tooling.