Skip to content

Commit

Permalink
fix "File does not contain tensor conditioner.embedders.0.transformer…
Browse files Browse the repository at this point in the history
….text_model.embeddings.position_ids" error with SDXL models

issue #136 reported by @CCpt5
  • Loading branch information
wkpark committed Apr 13, 2024
1 parent efc73c0 commit 1701dd3
Showing 1 changed file with 5 additions and 1 deletion.
6 changes: 5 additions & 1 deletion scripts/model_mixer.py
Original file line number Diff line number Diff line change
Expand Up @@ -3804,7 +3804,11 @@ def dare_merge(theta0, theta1, alpha, p):
sel_keys = changed_keys if partial_update else keys

# save some dicts
checkpoint_dict_skip_on_merge = ["cond_stage_model.transformer.text_model.embeddings.position_ids", "conditioner.embedders.1.model.transformer.text_model.embeddings.position_ids" ]
checkpoint_dict_skip_on_merge = [
"cond_stage_model.transformer.text_model.embeddings.position_ids",
"conditioner.embedders.0.transformer.text_model.embeddings.position_ids",
"conditioner.embedders.1.model.transformer.text_model.embeddings.position_ids",
]
for k in checkpoint_dict_skip_on_merge:
if k in sel_keys:
sel_keys.remove(k)
Expand Down

0 comments on commit 1701dd3

Please sign in to comment.