Skip to content

Enable PEFT adapter initialization#229

Merged
norabelrose merged 6 commits intomainfrom
init-lora
Apr 6, 2026
Merged

Enable PEFT adapter initialization#229
norabelrose merged 6 commits intomainfrom
init-lora

Conversation

@luciaquirke
Copy link
Copy Markdown
Collaborator

@luciaquirke luciaquirke commented Apr 3, 2026

Currently users who want to run MAGIC with a PEFT adapter have to create it then save it to disk then load it with the MAGIC trainer.

  • Add PEFT initialization capabilities through peft_init_kwargs
  • Enable passing arbitrary HF model loading args through model_kwargs (I realized this was missing during testing)
  • Rename all the x_args to x_kwargs since only kwargs are actually parsed correctly (tech debt from copying this code from the LM Eval Harness)

@luciaquirke luciaquirke requested a review from norabelrose April 3, 2026 03:56
@norabelrose norabelrose merged commit 9de6685 into main Apr 6, 2026
4 of 6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants