Skip to content

add ci job for eval_llama with mmlu task #6337

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 1 commit into from
Closed

add ci job for eval_llama with mmlu task #6337

wants to merge 1 commit into from

Conversation

helunwencser
Copy link
Contributor

@helunwencser helunwencser commented Oct 17, 2024 •
edited
Loading

@helunwencser
Update
fe5eadd 
[ghstack-poisoned]
@helunwencser helunwencser mentioned this pull request Oct 17, 2024
Closed
@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Oct 17, 2024 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/6337

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit fe5eadd with merge base 8f6c16e (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

helunwencser added a commit that referenced this pull request Oct 17, 2024
@helunwencser
add ci job for eval_llama with mmlu task
dd78ac2 
ghstack-comment-id: 2412077951

ghstack-source-id: 10cf92b
Pull Request resolved: #6337
@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Oct 17, 2024
@helunwencser helunwencser changed the base branch from gh/helunwencser/57/base to main October 17, 2024 21:42
@helunwencser helunwencser changed the base branch from main to gh/helunwencser/57/base October 17, 2024 21:42
@helunwencser
Copy link
Contributor Author

@helunwencser has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

This was referenced Oct 17, 2024
Closed
Closed
Closed
cccclai
cccclai approved these changes Oct 18, 2024
View reviewed changes
Copy link
Contributor

@cccclai cccclai left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great to have more test coverage :)

@helunwencser
Copy link
Contributor Author

@helunwencser has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

2 similar comments
@helunwencser
Copy link
Contributor Author

@helunwencser has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

@helunwencser
Copy link
Contributor Author

@helunwencser has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

@facebook-github-bot
Copy link
Contributor

@helunwencser merged this pull request in 179fd69.

kedarnath03 pushed a commit to kedarnath03/executorch that referenced this pull request Jun 25, 2025
@helunwencser
add ci job for eval_llama with mmlu task
0a21fd0 
ghstack-comment-id: 2412077951

ghstack-source-id: 10cf92b
Pull Request resolved: pytorch/executorch#6337
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@cccclai cccclai cccclai approved these changes

Assignees

No one assigned

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Merged

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@helunwencser @facebook-github-bot @cccclai