- Clone this repository and navigate to RBDash folder
git clone https://github.com/rbdash.git
cd RBDash
- Install Package
conda create -n rbdash python=3.10 -y
conda activate rbdash
pip install --upgrade pip # enable PEP 660 support
pip install -e .
- Install additional packages for training cases
pip install ninja
pip install flash-attn --no-build-isolation
git pull
pip uninstall transformers
pip install -e .
In RBDash, we evaluate models on MME.
- Download the data following the official instructions here.
- Downloaded images to
./playground/data/eval/MME/MME_Benchmark_release_version
. - Downloaded and put the weights to
./models/rbdash-v1-13b
- Single-GPU inference and evaluate.
CUDA_VISIBLE_DEVICES=0 bash scripts/v1/eval/mme.sh