Search results

A Better Evaluation Entry for OpenAI-Style API Models

Status: Open.

#1094 In open-compass/VLMEvalKit;

· Ezra-Yu opened on Jun 20, 2025

Can't Reproduce the results of Qwen2_5_vl -3B on MMMU_DEV_VAL and AI2D_TEST

Status: Open.

#1092 In open-compass/VLMEvalKit;

· bollossom opened on Jun 19, 2025

Why doesn’t VizWiz’s <code>build_prompt</code> include the short-answer instruction like <code>ImageVQADataset</code>?

Status: Open.

#1090 In open-compass/VLMEvalKit;

· zihuanqiu opened on Jun 19, 2025

使用lmdeploy openai api运行到一半总是会卡住

Status: Open.

#1089 In open-compass/VLMEvalKit;

· yfl-rgb opened on Jun 19, 2025

Finetuned LLaVA Model output

Status: Open.

#1087 In open-compass/VLMEvalKit;

· JVal123 opened on Jun 17, 2025

Janus-Pro+GenEval

Status: Open.

#1085 In open-compass/VLMEvalKit;

· Fafap131 opened on Jun 17, 2025

InternVL3如何限制图片的max_pixels

Status: Open.

#1078 In open-compass/VLMEvalKit;

· Tunanzzz opened on Jun 14, 2025

add AI/ML API as provider

Pending

Status: Open.

#1073 In open-compass/VLMEvalKit;

· OctavianTheI opened on Jun 12, 2025

测试速度问题

Status: Open.

#1072 In open-compass/VLMEvalKit;

· wangat opened on Jun 12, 2025

[Bug] VRAM is not released when using multiple model

BUGSomething isn't workingSomething isn't working

Status: Open.

#1069 In open-compass/VLMEvalKit;

· hebangwen opened on Jun 12, 2025

Support judge model for MAC&amp;ShortVQA Question

enhancementNew feature or requestNew feature or request

Status: Open.

#1066 In open-compass/VLMEvalKit;

· Ezra-Yu opened on Jun 11, 2025

GUI tsv file

Status: Open.

#1058 In open-compass/VLMEvalKit;

· AdvancedBot opened on Jun 10, 2025