RuntimeError: Expected query, key, and value to have the same dtype, but got query.dtype: c10::Half key.dtype: float and value.dtype: float instead.

[kmlcnclk]

RuntimeError: Expected query, key, and value to have the same dtype, but got query.dtype: c10::Half key.dtype: float and value.dtype: float instead.

I am getting an error like above when ı train dreambooth modal on Stable Diffusion.

Can you help me about that?

[github-actions]

This issue is stale because it has been open for 14 days with no activity. Remove stale label or comment or this will be closed in 30 days

[vanangelov]

I have the same issue on a M1 Mac. Neither using the "Upcast cross attention layer to float32" SD option, nor "--no-half" seem to fix it.

[kmlcnclk]

I have the same issue on a M1 Mac. Neither using the "Upcast cross attention layer to float32" SD option, nor "--no-half" seem to fix it.

I am using Mac M1 too.

[vanangelov]

Changing Settings > Performance > Mixed Precision to NO seems to fix this

[github-actions]

This issue is stale because it has been open for 14 days with no activity. Remove stale label or comment or this will be closed in 30 days

[malcolmacronis]

Using M1 Pro 32gb ram, nothing from above fixes this.

[github-actions]

This issue is stale because it has been open for 14 days with no activity. Remove stale label or comment or this will be closed in 30 days

[carlokarton]

Did anyone find a solution ?

[github-actions]

This issue is stale because it has been open for 14 days with no activity. Remove stale label or comment or this will be closed in 30 days