Skip to content

Support qwen 0.5 b #13972

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Sep 5, 2025
Merged

Support qwen 0.5 b #13972

merged 1 commit into from
Sep 5, 2025

Conversation

cccclai
Copy link
Contributor

@cccclai cccclai commented Sep 4, 2025

Summary:
Add entry point to run 0.5B model. Run with

 buck run mode/dev-nosan //executorch/extension/llm/export:export_llm -- --config executorch/examples/models/llama/config/llama_bf16.yaml +base.model_class="qwen2_5_0_5b" +base.params="./executorch/examples/models/qwen2_5/config/0_5b_config.json"

Differential Revision: D81724880

@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Sep 4, 2025 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/13972

Note: Links to docs will display an error until the docs builds have been completed.

❌ 1 New Failure, 1 Pending

As of commit d02fcf1 with merge base 646e0c4 (image):

NEW FAILURE - The following job has failed:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Sep 4, 2025
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D81724880

@github-actions GitHub Actions
Copy link

github-actions bot commented Sep 4, 2025

This PR needs a release notes: label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

@cccclai @facebook-github-bot
Support qwen 0.5 b (pytorch#13972)
d02fcf1 
Summary:

Add entry point to run 0.5B model. Run with
```
 buck run mode/dev-nosan //executorch/extension/llm/export:export_llm -- --config executorch/examples/models/llama/config/llama_bf16.yaml +base.model_class="qwen2_5_0_5b" +base.params="./executorch/examples/models/qwen2_5/config/0_5b_config.json"
```

Differential Revision: D81724880
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D81724880

@cccclai cccclai merged commit d5a5164 into pytorch:main Sep 5, 2025
116 of 118 checks passed
@shoumikhin
Copy link
Contributor

@cccclai CI trunk job test-models-linux-aarch64 looks broken after this change, ptal

@jackzhxng
Copy link
Contributor

Update tests here -

executorch/examples/models/__init__.py

Line 38 in 8456567

Qwen25 = "qwen2_5"

executorch/.ci/scripts/test_model.sh

Line 100 in 8456567

if [[ "${MODEL_NAME}" == "qwen2_5" ]]; then

executorch/.github/workflows/trunk.yml

Line 179 in 8456567

- model: qwen2_5

cccclai added a commit to cccclai/executorch-1 that referenced this pull request Sep 5, 2025
@cccclai @facebook-github-bot
Fix qwen2.5 1.5b test
fe31533 
Summary:
Forward fix for pytorch#13972

Rollback Plan:

Differential Revision: D81789757
@cccclai cccclai mentioned this pull request Sep 5, 2025
Merged
@cccclai
Copy link
Contributor Author

cccclai commented Sep 5, 2025

.github/workflows/trunk.yml

Thanks for the code pointer. Fix is here #14013

shoumikhin pushed a commit that referenced this pull request Sep 5, 2025
@cccclai
Fix qwen2.5 1.5b test (#14013)
364f493 
Summary:
Forward fix for #13972

Rollback Plan:

Differential Revision: D81789757
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@jackzhxng jackzhxng jackzhxng approved these changes

@larryliu0820 larryliu0820 Awaiting requested review from larryliu0820 larryliu0820 is a code owner

@swolchok swolchok Awaiting requested review from swolchok swolchok is a code owner

@mergennachin mergennachin Awaiting requested review from mergennachin mergennachin is a code owner

@lucylq lucylq Awaiting requested review from lucylq lucylq is a code owner

Assignees
No one assigned
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@cccclai @facebook-github-bot @shoumikhin @jackzhxng