You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
To me, this sounds like the caller code (from unsloth) is doing something incorrectly. Could you please provide a minimal code sample to reproduce the error?
peft = 0.7.0
When I use the unsloth github repo to faster my qlora finetune code, a TypeError would occur. And the error refers to: https://github.com/huggingface/peft/blob/504d3c832968358498f02b2beac032ed95ef8467/src/peft/tuners/lora/bnb.py#L202C13-L202C92
self.update_layer(adapter_name, r, lora_alpha, lora_dropout, init_lora_weights)
I change the line above into
self.update_layer(adapter_name, r.r, lora_alpha, lora_dropout, init_lora_weights)
The TypeError would be fixed.
The text was updated successfully, but these errors were encountered: