SVD update with conv support + LoRA add, weight update following recent updates

[cloneofsimo]

This will update other features to incorporate resnet blocks in them as well.

[cloneofsimo]

Examples with Modern disney diffusion and Analog diffusion

[cloneofsimo]

Lora adding is now updated! This implementation is likely to be futureproof.

[cloneofsimo]

Comment : Example use case
lora_add runwayml/stable-diffusion-v1-5 ./example_loras/lora_krk.safetensors ./output_merged 0.8 --mode upl
lora_add ./example_loras/analog_svd_rank4.safetensors ./example_loras/lora_krk.safetensors ./krk_analog.safetensors 2.0 0.7

[cloneofsimo]

Sorry for taking ridiculous long for this update. Wild bug! Anyways, merging now works and this implementation is much canonical as well.

[cloneofsimo]

CKPT done as well. As for PTI, textual inversion for A1111 is supported as well.

lora_add runwayml/stable-diffusion-v1-5 ./example_loras/lora_krk.safetensors ./output_merged.ckpt --alpha_1 0.7 --mode upl-ckpt-v2

[satwiksunnam19]

RuntimeError: stack expects a non-empty TensorList
this is the error while converting the .safetensors to .ckpt format @cloneofsimo can you explain why this is happening ?