Skip to content

Yi-1.5-9B is not supported by the vllm or lmdeploy acceleration? I can not figure out ,why the evaluation process consume so much time ? when I evaluated in LLamaFactory on MMLU ,the process costs about 30 minutes, while with opencompass it cost at least 2 hours with the same four GPUS #1237

Unanswered
hzgdeerHo asked this question in Q&A
Discussion options

You must be logged in to vote

Replies: 0 comments

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
1 participant