Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

support rwkv5-3b learnboard #1

Merged
merged 5 commits into from
Nov 29, 2023
Merged

support rwkv5-3b learnboard #1

merged 5 commits into from
Nov 29, 2023

Conversation

BBuf
Copy link
Owner

@BBuf BBuf commented Nov 25, 2023

操作文档参考:https://opencompass.readthedocs.io/zh-cn/latest/get_started/quick_start.html

export HF_DATASETS_CACHE=xxx
export TRANSFORMERS_CACHE=xxx
git clone https://github.com/BBuf/opencompass
cd opencompass
pip install -r requirements.txt
pip install -e .

# python3 tools/prompt_viewer.py configs/eval_rwkv5_3b.py (可视化prompt,辅助debug)
# python run.py configs/eval_rwkv5_3b.py (运行rwkv-5-3b的评测,数据集可以通过 `opencompass/configs/models/rwkv/rwkv5_3b.py` 配置)

其它的rwkv类似模型做评测和这个pr类似。

@BBuf BBuf merged commit 3439cf5 into main Nov 29, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
1 participant