Issues loading LoRA weights

[pcuenca]

Reported here by https://discuss.huggingface.co/u/dkackman: https://discuss.huggingface.co/t/does-load-attn-procs-work-with-safetensors/34827. See also proposed patch by user https://discuss.huggingface.co/u/slavakurilyak.

[patrickvonplaten]

cc @sayakpaul here

[sayakpaul]

@patrickvonplaten the solution proposed here checks if the LoRA concerned keys are present before the state dict iteration. Could you take a look at that and accordingly we could check with slavakurilyak to see if they would be interested in a contribution.

[LIngerwsk]

Thank! Does the new_load_attn_procs work in the Diffusers with 0.14.0 version?
Or the load_attn_procs works with safetensors now?

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.