Skip to content

Latest commit

 

History

History
27 lines (20 loc) · 978 Bytes

Windows.md

File metadata and controls

27 lines (20 loc) · 978 Bytes
Raw

Run ViP-LLaVA on Windows

NOTE: ViP-LLaVA on Windows is not fully supported. Currently we only support 16-bit inference. For a more complete support, please use WSL2 for now. More functionalities on Windows is to be added soon, stay tuned.

Installation

  1. Clone this repository and navigate to ViP-LLaVA folder
git clone https://github.com/mu-cai/ViP-LLaVA.git
cd ViP-LLaVA
  1. Install Package
conda create -n vip-llava python=3.10 -y
conda activate vip-llava
python -mpip install --upgrade pip  # enable PEP 660 support
pip install torch==2.0.1+cu117 torchvision==0.15.2+cu117 torchaudio==2.0.2 --index-url https://download.pytorch.org/whl/cu117
pip install -e .
pip uninstall bitsandbytes

Run demo

See instructions here.

Note that quantization (4-bit, 8-bit) is NOT supported on Windows. Stay tuned for the 4-bit support on Windows!