VBench v0.1.2
Bug fixes
- Fix preprocessing for high-resolution images/videos in imaging_quality (46275d9, b484867)
- Fix VBench_full_info.json not found in PyPI package (90f0973)
Features
- Add
filter_scopeargument for selecting the videos to be considered for filtering out static videos (fb75b02) - Add
modeargument to select between three different evaluation modes (02e2ee1):
custom_input: Receive input prompt from --prompt/--prompt_file flags or read directly from the filename
vbench_standard: Evaluate using the standard prompt suite of VBench (default)
vbench_category: Evaluate using a specific category of VBench
- Allow evaluating with prompts specified by a file containing a dictionary using
--prompt_file. (efaa6d3)
Others Changes
- Receive list of dimension instead of single dimension in
--dimensionflag (91bece8)