Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Merge LoRA and base model #802

Merged
merged 20 commits into from
Apr 30, 2024
Merged

Merge LoRA and base model #802

merged 20 commits into from
Apr 30, 2024

Conversation

wheresmyhair
Copy link
Collaborator

@wheresmyhair wheresmyhair commented Apr 30, 2024 •
edited

Users can now merge LoRA weight and the base model into one using:

./scripts/run_merge_lora.sh \
  --model_name_or_path Qwen/Qwen1.5-1.8B \
  --lora_model_path output_models/lora \
  --output_model_path output_models/lora_merged \

Yizhen and others added 20 commits April 29, 2024 00:12
Qwen lora test shell
58963b1
Add merge lora script
af64349
@wheresmyhair
Add merge lora weight script
c0cda1c
@wheresmyhair
Add dtype when loading peft adapters
9b4d4b6
Merge lora shell bug fix
2332b47
@wheresmyhair
Merge lora gpu support
6e40320
@wheresmyhair
Merge lora script update
71ab5a4
@wheresmyhair
Qwen lora test shell
38f8f74
@wheresmyhair
Add merge lora script
c2b9f0c
@wheresmyhair
Add merge lora weight script
d378656
@wheresmyhair
Add dtype when loading peft adapters
25e5cad
@wheresmyhair
Merge lora shell bug fix
1ae1e1c
@wheresmyhair
Merge lora gpu support
c6bcee3
@wheresmyhair
Merge lora script update
fa28cc0
@wheresmyhair
Merge branch 'yizhenjia-qwen-support' of https://github.com/OptimalSc…
3ecb69a 
…ale/LMFlow into yizhenjia-qwen-support
@wheresmyhair
Merge LoRA weight README update and revert irrelevant changes
7d47137
@wheresmyhair
Revert irrelevant changes
6ff0896
@wheresmyhair
Revert irrelevant changes
414a74e
@wheresmyhair
Revert irrelevant changes
fc521d0
@wheresmyhair
Merge lora typo fix
b28fc04
research4pan
research4pan reviewed Apr 30, 2024
View reviewed changes
Copy link
Contributor

@research4pan research4pan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

README.md

  • line 189: typo: redundant "="

scripts/run_merge_lora.sh

  • line 43-55: can be removed since error is raised inside python.

research4pan
research4pan approved these changes Apr 30, 2024
View reviewed changes
Copy link
Contributor

@research4pan research4pan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@research4pan research4pan merged commit ffc527e into main Apr 30, 2024
2 checks passed
@wheresmyhair wheresmyhair deleted the yizhenjia-qwen-support branch May 1, 2024 15:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@research4pan research4pan research4pan approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
2 participants
@wheresmyhair @research4pan