Skip to content

Starter Task 1: Get learning rate for llm_pte_finetuning example from config file #11445

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Jun 7, 2025
Merged

Starter Task 1: Get learning rate for llm_pte_finetuning example from config file #11445

merged 1 commit into from
Jun 7, 2025
+11 −5

Conversation

IshanAryendu
Copy link
Contributor

Summary:

  1. Cloned Repository: Cloned the Qwen2-0.5B-Instruct repository from HuggingFace onto local desktop.
  2. Uploaded Files to OD Server: Uploaded cloned files to OD server (57651.od.fbinfra.net) at /tmp/Qwen2-0.5B-Instruct.
  3. Created a New Directory to save the pte model: Created a new directory model under fbcode/executorch/examples/llm_pte_finetuning.
  4. Configured Learning Rate: Updated qwen_05b_config.yaml file to set the learning rate to 5e-3 under model config parameters (line 22).
  5. Updated Runner Script: Modified runner.py file to use the learning rate from cfg.model.learning_rate (line 87).

Reviewed By: silverguo

Differential Revision: D75807517

@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Jun 6, 2025 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/11445

Note: Links to docs will display an error until the docs builds have been completed.

⏳ No Failures, 1 Pending

As of commit a5b9633 with merge base 2bb567f (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported labels Jun 6, 2025
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D75807517

@github-actions GitHub Actions
Copy link

github-actions bot commented Jun 6, 2025

This PR needs a release notes: label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D75807517

@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D75807517

@IshanAryendu @facebook-github-bot
Starter Task 1: Get learning rate for llm_pte_finetuning example from…
a5b9633 
… config file (#11445)

Summary:
Pull Request resolved: #11445

1. **Cloned Repository**: Cloned the relevant repository from a source onto the local desktop.
2. **Uploaded Files to Server**: Uploaded the cloned files to the server at `/tmp/Qwen2-0.5B-Instruct`.
3. **Created a New Directory for Model**: Created a new directory named `model` under `fbcode/executorch/examples/llm_pte_finetuning`.
4. **Configured Learning Rate**: Updated the configuration file to set the `learning_rate` to `5e-3` under model configuration parameters.
5. **Updated Runner Script**: Modified the script to use the learning rate from the configuration settings.

Reviewed By: mcr229, silverguo

Differential Revision: D75807517
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D75807517

@facebook-github-bot facebook-github-bot merged commit ae6b1f1 into pytorch:main Jun 7, 2025
104 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@JacobSzwejbka JacobSzwejbka Awaiting requested review from JacobSzwejbka JacobSzwejbka is a code owner

1 more reviewer

@mcr229 mcr229 mcr229 approved these changes

Reviewers whose approvals may not affect merge requirements

Assignees

No one assigned

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@IshanAryendu @facebook-github-bot @mcr229