Skip to content

VBench v0.1.2

Choose a tag to compare

@NattapolChan NattapolChan released this 04 Jun 16:42

Bug fixes

  • Fix preprocessing for high-resolution images/videos in imaging_quality (46275d9, b484867)
  • Fix VBench_full_info.json not found in PyPI package (90f0973)

Features

  • Add filter_scope argument for selecting the videos to be considered for filtering out static videos (fb75b02)
  • Add mode argument to select between three different evaluation modes (02e2ee1):

custom_input: Receive input prompt from --prompt/--prompt_file flags or read directly from the filename
vbench_standard: Evaluate using the standard prompt suite of VBench (default)
vbench_category: Evaluate using a specific category of VBench

  • Allow evaluating with prompts specified by a file containing a dictionary using --prompt_file. (efaa6d3)

Others Changes

  • Receive list of dimension instead of single dimension in --dimension flag (91bece8)