How to Merge 3 checkpoints in Google colab?

[matroxI]

Can I somehow combine 3 models if I don't have enough ram. I am using google colab.

[x-legion]

can you merge 2 checkpoints on colab?

[Miraculix200]

You probably have to find a standalone python script which does the merging, without running the webui.

[uservar]

Yes, you can merge 3 models with the free tier google colab.
You'd need to make the models load in VRAM and use --lowvram launch parameter.

Let's say your stable-diffusion-webui folder is at /content/stable-diffusion-webui then you'd do something like this:

%cd /content/stable-diffusion-webui
!sed -i "s/'cpu'/devices.get_optimal_device()/g" modules/extras.py
!python webui.py --share --lowvram

--lowvram parameter would make your generations very slow so don't forget to remove it and re-run once you're done merging.

Also if you have trouble loading certain 7GB models you can run this also: !sed -i 's/else "cpu"/else devices.get_optimal_device()/g' modules/shared.py

[matroxI]

It didn't work for me, I still can't combine 3 models. Can you give a link to the colab in which it works? And the --lowvram parameter, when merging 3 models, loads only 2 models, there is not enough memory for 3. Without this parameter, the colab crashes on model 3 loading, so this flag reduces performance.

[uservar]

I'm unsure why it wouldn't work for you, what gpu do you get? a Tesla T4 is sufficient for me to merge three 3.9G models. Maybe you're using a non-pruned 7GB model? In which case I haven't tested that out.

I made a quick colab example as you requested:
https://colab.research.google.com/drive/1Xt6-PUl4NmrP7VM3dcqGpWhOZyUNhtJ8

In case this issue persists, I would suggest trying out a different solution: #4151, or waiting until that pull request gets merged.

[nolanaatama]

it's working. thank you

[flesler]

Does merging models use GPU? To know if the notebook could simply be run with CPU instead
BTW this no longer works and throws an error with the latest A1111 version. I guess a git checkout to an older version will do

[TheBarret]

I'm unsure why it wouldn't work for you, what gpu do you get? a Tesla T4 is sufficient for me to merge three 3.9G models. Maybe you're using a non-pruned 7GB model? In which case I haven't tested that out.

I made a quick colab example as you requested: https://colab.research.google.com/drive/1Xt6-PUl4NmrP7VM3dcqGpWhOZyUNhtJ8

In case this issue persists, I would suggest trying out a different solution: #4151, or waiting until that pull request gets merged.

I hope you do not mind me using that opportunity to merge some models?! :D

[kopyl]

Could you please make a standalone checkpoint merger (of 2 models) without a WebUI? :)

[Marx2014]

You can use Google cloud disk, put the model in different accounts disk, and then share to the same folder, and then mount the disk to use