New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Weight mismatch with SD 2.1 #61

Open

ifeherva opened this issue Jan 12, 2024 · 1 comment

ifeherva commented Jan 12, 2024

If I understand the approach correctly the in blocks of SD 2.1 were frozen during training.

Yet, when I compare the weights between the checkpoint shared here vs the SD 2.1 on huggingface the weights, don't match. What am I missing?

For example the keys I am comparing from the 2 state dicts:

Anydoor checkpoint: model.diffusion_model.input_blocks.0.0.weight
vs.
SD 2.1 loaded as UNet2DConditionModel: conv_in.weight

Author

ifeherva commented Jan 12, 2024

I figured out what was happening, the link in the README points to SD-v2.1 however you used SD-2.1-base. I recommend to update the README :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment