Skip to content

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

2 Commits
Β 
Β 
Β 
Β 

Repository files navigation

**# AI-Server-Installer 1-Click Self-Hosted AI Server Installer **# ⚑ 1-Click Self-Hosted AI Server Installer

GitHub Stars License: MIT Docker

A production-ready, interactive Bash script to deploy a complete, secure, and private AI infrastructure on your local machine or remote VPS in under 2 minutes.

No complex manual configurations, no exposed ports, and zero trust by default.


πŸ› οΈ Architecture & What's Inside

This script automates the deployment of a containerized AI stack using Docker Compose and wraps it in a secure network layer:

  • Ollama: The backend engine running open-source LLMs (Llama 3, Mistral, Phi-3, etc.) locally with automatic GPU/CPU acceleration detection.
  • Open WebUI: A feature-rich, beautiful ChatGPT-like user interface connected directly to your Ollama instance.
  • zrok (by NetFoundry): A next-generation peer-to-peer sharing platform. It creates a secure Zero-Trust public tunnel to your Open WebUI interface, allowing you to access your private AI from your phone or share it with friends without public IP, port forwarding, or firewall changes.

✨ Features

  • πŸš€ True 1-Click Deployment: Automatically checks, installs, and configures Docker, Docker Compose, and necessary dependencies if missing.
  • πŸ”’ Secure Remote Access: Integrates zrok out of the box to expose your WebUI safely without risking your home network security.
  • 🧠 Hardware Auto-Detection: Automatically configures Docker to utilize NVIDIA GPUs (via nvidia-container-toolkit) for fast AI generation, falling back to optimized CPU threads if no GPU is found.
  • 🐳 Isolated Microservices: Everything runs in a dedicated Docker network with strict volume mappings for persistent data (your chats and downloaded models won't disappear).

πŸš€ Quick Start

Run the following command in your Linux terminal (Ubuntu/Debian/CentOS supported):

curl -sSL https://githubusercontent.com | bash

Prerequisites

  • A Linux machine or VPS (Ubuntu 22.04+ recommended).
  • A free zrok token (Get it in 30 seconds at zrok.io to enable remote access).

βš™οΈ Interactive Installer Flow

When you execute the script, it guides you through a clean, foolproof interactive CLI setup:

  1. Dependency Check: Validates OS, curl, git, docker, and docker-compose.
  2. Hardware Check: Scans for NVIDIA CUDA drivers to enable GPU pass-through.
  3. zrok Configuration: Prompts you to paste your zrok environment token (optional, but recommended for remote access).
  4. Boot Up: Generates the optimized docker-compose.yml file dynamically and fires up the containers.
  5. Output Summary: Prints local access URLs and your unique secure public zrok link.

πŸ“‚ Repository Structure

  • install.sh β€” The main interactive Bash orchestrator (dependency checks, env generation, validation).
  • templates/docker-compose.template.yml β€” Clean multi-container architecture template.
  • config/ β€” Configuration directories for Ollama and zrok environments.

🀝 Contributing & Support

If you found this script useful, please give it a ⭐ Star! It helps other self-hosted and AI enthusiasts discover this tool.

Feel free to open an Issue or submit a Pull Request if you want to add more tools to the stack (e.g., Stable Diffusion, Vector DBs, or monitoring tools).

License: MIT

About

1-Click Self-Hosted AI Server Installer

Resources

Stars

Watchers

Forks

Releases

Packages

Contributors