Skip to content

Introduce MultimethodLoraConfig#17455

Merged
lucylq merged 4 commits intomainfrom
gh/lucylq/133/orig
Feb 13, 2026
Merged

Introduce MultimethodLoraConfig#17455
lucylq merged 4 commits intomainfrom
gh/lucylq/133/orig

Conversation

@pytorchbot
Copy link
Copy Markdown
Collaborator

This PR was created by the merge bot to help merge the original PR into the main branch.
ghstack PR number: #17230 by @lucylq
^ Please use this as the source of truth for the PR details, comments, and reviews
ghstack PR base: https://github.com/pytorch/executorch/tree/gh/lucylq/133/base
ghstack PR head: https://github.com/pytorch/executorch/tree/gh/lucylq/133/head
Merge bot PR base: https://github.com/pytorch/executorch/tree/gh/lucylq/132/orig
Merge bot PR head: https://github.com/pytorch/executorch/tree/gh/lucylq/133/orig
Differential Revision: D92315627
@diff-train-skip-merge

@pytorch-bot
Copy link
Copy Markdown

pytorch-bot Bot commented Feb 13, 2026

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/17455

Note: Links to docs will display an error until the docs builds have been completed.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Feb 13, 2026
Github Executorch added 2 commits February 13, 2026 12:19
Pull Request resolved: #17228

Specify which method to call in the runner.

ghstack-source-id: 340390608
@exported-using-ghexport

Differential Revision: [D92225533](https://our.internmc.facebook.com/intern/diff/D92225533/)
Pull Request resolved: #17229

Introduce LoraConfig to hold lora parameters such as:
- checkpoint
- rank
- target_modules (e.g. q_proj, k_proj, v_proj, up_proj, down_proj, gate_proj, o_proj)
- lora_alpha

LoraConfig validation done post-init. LoraConfig can be created with config.json file.

Update cases of export_llama_lib to use LoraConfig instead of adapter_checkpoint and adapter_config.

NOTE: we may need to extend this to support more customizable features like lora config per layer etc. cc @hakanb

ghstack-source-id: 340930093
@exported-using-ghexport

Differential Revision: [D92304723](https://our.internmc.facebook.com/intern/diff/D92304723/)
Pull Request resolved: #17230

MultimethodLoraConfig; collects together method name and lora config.

ghstack-source-id: 341143477
@exported-using-ghexport

Differential Revision: [D92315627](https://our.internmc.facebook.com/intern/diff/D92315627/)
@lucylq lucylq force-pushed the gh/lucylq/133/orig branch from e057f93 to 2ed0f5e Compare February 13, 2026 20:19
@lucylq lucylq force-pushed the gh/lucylq/132/orig branch from 86c70a9 to be0d894 Compare February 13, 2026 20:19
@lucylq lucylq changed the base branch from gh/lucylq/132/orig to main February 13, 2026 20:19
@github-actions
Copy link
Copy Markdown

This PR needs a release notes: label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

@lucylq lucylq merged commit 6e31609 into main Feb 13, 2026
131 checks passed
@lucylq lucylq deleted the gh/lucylq/133/orig branch February 13, 2026 20:56
chizkiyahu pushed a commit to chizkiyahu/executorch that referenced this pull request Feb 23, 2026
This PR was created by the merge bot to help merge the original PR into
the main branch.
ghstack PR number: pytorch#17230 by
@lucylq
^ Please use this as the source of truth for the PR details, comments,
and reviews
ghstack PR base:
https://github.com/pytorch/executorch/tree/gh/lucylq/133/base
ghstack PR head:
https://github.com/pytorch/executorch/tree/gh/lucylq/133/head
Merge bot PR base:
https://github.com/pytorch/executorch/tree/gh/lucylq/132/orig
Merge bot PR head:
https://github.com/pytorch/executorch/tree/gh/lucylq/133/orig
Differential Revision:
[D92315627](https://our.internmc.facebook.com/intern/diff/D92315627/)
@diff-train-skip-merge

---------

Co-authored-by: Github Executorch <github_executorch@arm.com>
Co-authored-by: lucylq <lfq@meta.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants