From 5940554682ca3ef37ef3750a3e180a12b2b8424f Mon Sep 17 00:00:00 2001 From: simon-lund <41208671+simon-lund@users.noreply.github.com> Date: Fri, 9 Feb 2024 16:30:55 +0100 Subject: [PATCH] Update the link for the SEED-Bench benchmark instructions The DATASET.md file of Seed-Bench now contains instructions for both versions of Seed-Bench (v1 and v2). In the LLaVA-1.5 paper, you reference the paper presenting Seed-Bench-1. So, this link as it is now might be confusing, and I'd like to add an anchor pointing to the section about data preparation for Seed-Bench-1. --- docs/Evaluation.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/Evaluation.md b/docs/Evaluation.md index 3e46a98ce..0ddbdb989 100644 --- a/docs/Evaluation.md +++ b/docs/Evaluation.md @@ -117,7 +117,7 @@ CUDA_VISIBLE_DEVICES=0 bash scripts/v1_5/eval/mmbench_cn.sh ### SEED-Bench -1. Following the official [instructions](https://github.com/AILab-CVC/SEED-Bench/blob/main/DATASET.md) to download the images and the videos. Put images under `./playground/data/eval/seed_bench/SEED-Bench-image`. +1. Follow the official instructions [Data Preparation for SEED-Bench-1](https://github.com/AILab-CVC/SEED-Bench/blob/main/DATASET.md#data-preparation-for-seed-bench-1) to download the images and the videos. Put images under `./playground/data/eval/seed_bench/SEED-Bench-image`. 2. Extract the video frame in the middle from the downloaded videos, and put them under `./playground/data/eval/seed_bench/SEED-Bench-video-image`. We provide our script `extract_video_frames.py` modified from the official one. 3. Multiple-GPU inference and evaluate. ```Shell