Skip to content

ViperX7/Alpaca-Turbo

Repository files navigation

Alpaca-Turbo

Licence

GitHub release (latest by date) Commits/month

Contributors Downloads Discord

Alpaca-Turbo is a frontend to use large language models that can be run locally without much setup required. It is a user-friendly web UI for the llama.cpp , with unique features that make it stand out from other implementations. The goal is to provide a seamless chat experience that is easy to configure and use, without sacrificing speed or functionality.

📝 Example views

demo.mp4

📦 Installation Steps

📺 Video Instructions

  • ToDo
  • ToDo

🐳 Using Docker (only Linux is supported with docker)

  • ToDo

🪟 Using Windows (standalone or miniconda) AND Mac M1/M2 (using miniconda)

  1. Links for installing miniconda:
    • Windows
    • Mac M1/M2
      • Install for all users
      • Make sure to add c:\ProgramData\miniconda3\condabin to your environment variables
  2. Download the latest alpaca-turbo.zip from the release page.
  3. Extract Alpaca-Turbo.zip to Alpaca-Turbo

Make sure you have enough space for the models in the extracted location

  1. Copy your alpaca models to alpaca-turbo/models/ directory.

  2. Open cmd as Admin and type

    conda init
    
  3. close that window

  4. open a new cmd window in your Alpaca-Turbo dir and type

    conda create -n alpaca_turbo python=3.10 -y
    conda activate alpaca_turbo
    pip install -r requirements.txt
    python app.py
    
  5. ready to interact

Directly installing with Pip

just get the latest release unzip and then run

pip install -r requirements.txt
python app.py

💁 Contributing

As an open source project in a rapidly developing field, I am open to contributions, whether it be in the form of a new feature, improved infra, or better documentation.

For detailed information on how to contribute.

🙌 Credits

🌟 History

Star History Chart