Butler.AI is a local fully uncensored AI assistant, features include :
- Customizable Avatars
- Poses
- Talking capabilities
- Fully Local (You are always in control)
- Uncensored (Free to use abliterated models or jb-prompts)
- Node.js 20+ (recommended) for running locally
- Docker Desktop (optional) for containerized runs
- Dedicated CUDA enabled GPU for faster inference (optional, you need to uncomment gpu capabilities in docker compose file)
- Models are generated via https://readyplayer.me/ or glb files also supported as long as its rigged. Just place them in the
static/avatarsand update theSettingsPanel.svelte - Actions are plain Mixamo Actions, same drill to add more.
cd Ui
npm install
npm run devUI only
docker compose --profile ui upUseful if you want to run ollama externally, openai compatible APIs are supported, change the OLLAMA_BASE_URL env variable accordingly.
UI + Ollama (optional):
docker compose --profile full upOllama will be reachable at http://localhost:11434.
(You must have models downloaded manually in ollama)
docker exec butlerai-ollama-1 ollama pull llama3.2:3bSvelteKit can be built and previewed locally:
cd Ui
npm run build
npm run dev-
The UI talks to Ollama using docker. If you run Ollama elsewhere, adjust your environment accordingly in
docker-compose.ymlthe env variableOLLAMA_BASE_URL. -
If you face wasm errors, just reload the page.
This project would not have been possible without Talking Head & HeadTTS
