-
Notifications
You must be signed in to change notification settings - Fork 315
Issues: open-compass/opencompass
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
[Bug] Passing
trust_remote_code=True
will be mandatory to load this dataset from the next major release of datasets
.
#1233
opened Jun 9, 2024 by
chairmanQi
2 tasks done
[Bug] When testing on gen datasets, even if the output is empty or incorrect, unexpected scores can be obtained
#1232
opened Jun 7, 2024 by
chairmanQi
2 tasks done
大海捞针数据集初始化报错( Failed to get opencompass.datasets.needlebench.origin.NeedleBenchOriginDataset)
#1229
opened Jun 6, 2024 by
macheng6
2 tasks done
[Bug] run pytorch Qwen-7B-Chat with ARC-c ppl under CPU ,and result is not good
#1226
opened Jun 5, 2024 by
FlexLaughing
2 tasks done
[Bug] which version of the dataset should be selected When evaluating the Llama3 model,
#1223
opened Jun 3, 2024 by
bullw
2 tasks done
[Bug] llm-compression task faild at eval stage with latest version
#1222
opened Jun 1, 2024 by
mqy004
2 tasks done
[Bug] configs/datasets/agieval/agieval_mixed_713d14.py not found
#1220
opened May 31, 2024 by
Galaxy-Husky
2 tasks done
[Bug] hf_chatglm3_6b评测AFQMC数据集时,自测结果与官方不一致。且自测结果不稳定。
#1202
opened May 28, 2024 by
jieheroli
2 tasks done
[Bug] run with transformers==4.40.2, error "HuggingFacewithChatTemplate does not support ppl-based evaluation".
#1157
opened May 15, 2024 by
zhulinJulia24
2 tasks done
Previous Next
ProTip!
Adding no:label will show everything without a label.