Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature] Add CMB zero-shot evaluation #571

Merged
merged 1 commit into from
Nov 12, 2023
Merged

[Feature] Add CMB zero-shot evaluation #571

merged 1 commit into from
Nov 12, 2023

Conversation

Leymore
Copy link
Collaborator

@Leymore Leymore commented Nov 10, 2023 •
edited
Loading

Prepare CMB Data

wget https://github.com/FreedomIntelligence/CMB/raw/main/data/CMB.zip
unzip CMB.zip
mv CMB/CMB-Exam/CMB-val/CMB-val-merge.json data/CMB/val.json
mv CMB/CMB-Exam/CMB-test/CMB-test-choice-question-merge.json data/CMB/test.json

And this is what in the data/CMB folder:

$ tree data/CMB
data/CMB
├── test.json
└── val.json
$ md5sum data/CMB/*
8ffcc8b1823141235d08f49ed684f2aa  data/CMB/test.json
234b62d5c207dab61b932fc0d6c48fc7  data/CMB/val.json

tonysy
tonysy approved these changes Nov 10, 2023
View reviewed changes
Copy link
Collaborator

@tonysy tonysy left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@Leymore Leymore merged commit d6aaac2 into open-compass:main Nov 12, 2023
3 checks passed
liushz pushed a commit to liushz/opencompass that referenced this pull request Nov 27, 2023
@Leymore @BunnyRunnerX
Update cmb (open-compass#571)
59efb8f
liuyaox pushed a commit to liuyaox/opencompass that referenced this pull request Jun 26, 2024
@Leymore
[Feature] Update cmb (open-compass#571)
3f7657b
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@tonysy tonysy tonysy approved these changes

Assignees

@tonysy tonysy

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
2 participants
@Leymore @tonysy