Alpaca WebUI, initially crafted for Ollama, is a chat conversation interface featuring markup formatting and code syntax highlighting. It supports a variety of LLM endpoints through the OpenAI Chat Completions API and now includes a RAG (Retrieval-Augmented Generation) feature, allowing users to engage in conversations with information pulled from uploaded documents.
The app lets you easily try out different AI models from various services to find answers using your documents. It simplifies mixing and matching these models to see which one works best for your needs.
Has
- Support for your local or remote Ollama server
- Compatible with OpenAI Chat Completions API
- Workes with OpenAI, Together.ai, Mistral.ai, Groq.com and Ollama
- Upload document (pdf, txt, docx) for RAG usage
- Modify System Prompt for Chat and RAG
- Markup Formatting
- Code Syntax Highlighting
- List available models for services supporting OpenAI API model endpoint (and listing of Ollama models)
- Mobile-Friendly and Desktop-Friendly Layout
Pending Implementation
- Modify Parameters (like temperature, mirostat ...)
- Attach ImageFile
- Chat History
Env
This is a Next.js project bootstrapped with create-next-app.
git clone https://github.com/mmo80/alpaca-webui.git- Setup and install your Weaviate database or just use the docker-compose weaviate file in the repository with the following command
docker-compose -f docker-compose.weaviate.yml up --build --detach. - Check the environment variables in
.env.development - Then just run
npm installfollowed bynpm run dev😎
Open http://localhost:3000 with your browser to start using the app.
This command sets up two containers: one for the app and another for the Weaviate vector database. (Please note that there is no data persistence on a mapped volume in this configuration.)
docker compose up --detachThen Open http://localhost:3033 with your browser to start using the app.
The official Alpaca WebUI Docker Image forloopse/alpaca-webui is available on Docker Hub.
