🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open-source LLMs.

🕵️‍♂️ Library designed for developers eager to explore the potential of Large Language Models (LLMs) and other generative AI through a clean, effective, and Go-idiomatic approach.

The open-source serverless GPU container runtime.

AI Gateway - core infrastructure stack for building production-ready AI Applications

🐦 A open blazing-fast simple model gateway for rapid development of production GenAI apps

AWS Go SDK examples for Amazon Bedrock

A generative AI-driven CLI for testing

A Go API client library for the ElevenLabs speech synthesis platform

This repository is a work in progress (WIP).

Experimenting Weaviate vector database with OpenAI vectorizer module and generative search

langchaingo wrapper implementations for Amazon Bedrock

AWS Go SDK examples for Amazon Bedrock

langchain Vector Store implementation based for PostgreSQL pgvector

Sister project to OpenLLMetry, but in Go. Open-source observability for your LLM application, based on OpenTelemetry

Chat history (memory) implementation for LangChain based on DynamoDB

prompt caching to save dollars on generative AI API usage.

Implement RAG (using LangChain and PostgreSQL) for Go applications to improve the accuracy and relevance of LLM outputs

A CLI and Go package to interact with Microsoft Designer to generate images.

Waldo is a command-line AI assistant that wraps around local LLMs, Google's Gemini models and OpenAI's GPT models

Command-line tool for AI-powered text and code generation using Gemini AI, OpenAI and GPT4ALL APIs.