🔒 Portable Uncensored AI — Runs Entirely from a USB Drive

A fully private, portable, uncensored AI assistant that runs 100% from a USB flash drive. No internet needed after setup. No data leaves the USB. Works on both Windows and Mac.

Now with multi-model support! Choose from 6 curated AI models or bring your own.

📺 Watch the Tutorial

⚡ Available Models

During installation, you'll choose which model(s) to download:

#	Model	Size	Label	Best For
1	NemoMix Unleashed 12B	~7.0 GB	🔓 UNCENSORED	⭐ Recommended — best quality uncensored
2	Dolphin 2.9 Llama 3 8B	~4.9 GB	🔓 UNCENSORED	Classic uncensored all-rounder
3	Mistral 7B Instruct v0.3	~4.1 GB	🔒 STANDARD	Strong reasoning & coding
4	Qwen 2.5 7B Instruct	~4.7 GB	🔒 STANDARD	Great multilingual support
5	Llama 3.2 3B Instruct	~2.0 GB	🔒 STANDARD	Lightweight — fast on old PCs
6	Phi-3.5 Mini 3.8B	~2.2 GB	🔒 STANDARD	Lightweight — good reasoning
C	Custom GGUF	Varies	🎨 CUSTOM	Bring your own HuggingFace model

🔓 UNCENSORED = No content filters, answers everything
🔒 STANDARD = Normal safety guidelines apply

🚀 Setup (One Time Only)

What You Need

• A USB flash drive with at least 16 GB of free space (32 GB recommended for multiple models)
• Format the USB as exFAT (works on both Windows and Mac)
• An internet connection for the initial download

Steps

1. Download this repo and copy ALL files to your USB drive
2. Double-click install.bat on the USB drive
3. Choose your model(s) from the interactive menu
4. Interactive AnythingLLM Setup:
   • The AnythingLLM installer will open automatically.
   • IMPORTANT: When asked for the "Install Location", click Browse and select the anythingllm folder on your USB drive.
   • Wait for it to finish, then close the installer window.
5. Done! Your portable AI is ready to use.

⚠️ If a Model Download Fails

The installer automatically retries failed downloads. If it still fails:

1. Download the model manually from the HuggingFace resolved link shown in the console error.
2. Place the .gguf file into the models\ folder on your USB.
3. Re-run install.bat — it will detect the file and skip the download.

🔄 Adding More Models Later

Just re-run install.bat and select additional models. Already-downloaded models are automatically skipped.

🎨 Custom Models

Want a model not on the list? During install, choose option C and paste any direct .gguf download link from HuggingFace. The installer handles the rest!

▶️ How to Use

On Windows

• Double-click start-windows.bat on the USB drive.
• Improved Portability: The launcher now automatically clears old path caches. This allows you to move between different computers without "JavaScript errors."
• The AnythingLLM chat window will open automatically.
• Switch between models in AnythingLLM: Settings → LLM → select your model.
• Keep the black terminal window open while chatting.
• Press any key in the terminal to safely shut down.

On Mac

• Double-click start-mac.command on the USB drive.
• First time: It will automatically download the Mac engine (~2 min).
• The AnythingLLM window will open automatically.
• Press ENTER in the terminal to safely shut down.

🔐 Privacy

• All chats & settings stay on the USB — never saved to the host PC.
• No registry keys or local files are left behind.
• Works completely offline after initial setup.
• No telemetry, no cloud, no tracking.

📁 USB Drive Structure (After Setup)

USB Drive/
├── install.bat             ← Run this first (one time only)
├── install-core.ps1        ← Setup script (called by install.bat)
├── start-windows.bat       ← Windows launcher (with auto-cache clearing)
├── start-mac.command       ← Mac launcher
├── ollama/                 ← AI engine (Windows)
├── models/                 ← AI model files (.gguf) & configs
│   ├── installed-models.txt    ← List of installed models
│   └── *.gguf                  ← Model weights
├── anythingllm/            ← Your AI Interface (installed here)
├── installer_data/         ← Temporary installer files (auto-cleaned)
└── anythingllm_data/       ← Your chats & settings (100% portable!)

💾 USB Size Guide

Models	Minimum USB	Recommended USB
1 lightweight (3B/3.8B)	16 GB	16 GB
1 recommended (NemoMix 12B)	16 GB	32 GB
2-3 models	32 GB	64 GB
All 6 presets (~25 GB)	64 GB	64 GB

⚠️ Important Notes

• Manual Path Selection: When installing AnythingLLM, you must manually select the anythingllm folder on the USB to keep it portable.
• Moving between PCs: If you see a "JavaScript Error" on a new PC, just close it and run start-windows.bat again. The script will automatically wipe the old PC's cached paths and fix the run.
• Performance: The AI runs on your CPU — responses take 10–30 seconds depending on hardware.
• RAM: 12B models (NemoMix) need at least 8 GB RAM. 7B models need at least 6 GB RAM.
• Always safely eject the USB before unplugging.

📜 License

MIT License — See LICENSE for details.