Skip to content

Latest commit

 

History

History
33 lines (19 loc) · 1.19 KB

merge_utils.md

File metadata and controls

33 lines (19 loc) · 1.19 KB

Model merge

PEFT provides several internal utilities for merging LoRA adapters with the TIES and DARE methods.

[[autodoc]] utils.merge_utils.prune

[[autodoc]] utils.merge_utils.calculate_majority_sign_mask

[[autodoc]] utils.merge_utils.disjoint_merge

[[autodoc]] utils.merge_utils.task_arithmetic

[[autodoc]] utils.merge_utils.ties

[[autodoc]] utils.merge_utils.dare_linear

[[autodoc]] utils.merge_utils.dare_ties