blend ONNX with LoRA and Textual Inversions in memory

[ssube]

• implement LoRA + ONNX blending
  • for sd-scripts
    • nn.Linear
    • nn.Conv2d 1x1
    • nn.Conv2d 3x3
• implement Textual Inversion + ONNX blending
• add a way to include LoRA models in the extras.json file
• save external weights in memory, no files
• add a way to specify LoRA models and their weights in the prompt
• document it in the user guide

For later:

• cloneofsimo lora support

[ssube]

This passed release tests on CUDA and DirectML and seems to be working.

I'll add support for cloneofsimo LoRAs later. They use the node index rather than path name, so finding those should be possible, but will be much more sensitive to optimizations.

[sonarcloud]

Kudos, SonarCloud Quality Gate passed!   

0 Bugs
0 Vulnerabilities
0 Security Hotspots
6 Code Smells

No Coverage information
0.0% Duplication