Search results

[Feature] 支持cleva的评测吗

Status: Open.

#2160 In open-compass/opencompass;

· lyp-liuyipeng opened on Jun 19, 2025

[Feature] 请问主观评测脚本支持用本地模型作为judge模型吗？

Status: Open.

#2159 In open-compass/opencompass;

· KAKSIS opened on Jun 18, 2025

[Bug] 评测ChemBench时导入数据集报错

Status: Open.

#2149 In open-compass/opencompass;

· lzpp2598 opened on Jun 13, 2025

[Feature] add AI/ML API as provider

Status: Open.

#2147 In open-compass/opencompass;

· OctavianTheI opened on Jun 12, 2025

[Bug] 运行example/eval_api_demo.py出错

Status: Open.

#2145 In open-compass/opencompass;

· chenly15 opened on Jun 11, 2025

[Bug] qwen2.5-3b-Instruct点数对不上, oc测出来只有52，qwen2.5论文里面是72.7

Status: Open.

#2141 In open-compass/opencompass;

· lll2343 opened on Jun 9, 2025

[Feature] Add mmlu-redux

Status: Open.

#2132 In open-compass/opencompass;

· hebangwen opened on Jun 3, 2025

[Feature] 想用此项目,评估多模态大模型的纯文本能力,这个项目可以评估吗?比如intervl2.5

Status: Open.

#2131 In open-compass/opencompass;

· GoogleAlphaZero opened on Jun 3, 2025

[Bug] LongBench v2 dataset config is incorrect

Status: Open.

#2129 In open-compass/opencompass;

· sserdoubleh opened on Jun 2, 2025

[Feature] 纯吐槽，Bug太多了，更新不及时！

Status: Open.

#2119 In open-compass/opencompass;

· moka11moka opened on May 26, 2025

[Bug] self.config becomes ' ' when using --debug

Status: Open.

#2114 In open-compass/opencompass;

· Zhaoyi-Yan opened on May 22, 2025

[Bug] Seems index is useless

Status: Open.

#2108 In open-compass/opencompass;

· Zhaoyi-Yan opened on May 20, 2025