"RuntimeError: "LayerNormKernelImpl" not implemented for 'Half'" whenever I try to generate an image - Mac mini (M1 2020), Big Sur 11.2.3 (20D91)

[JonWhitten]

Mac mini (M1 2020), Big Sur 11.2.3 (20D91)

As above, I can get into the web ui, then when I try to generate a cat it tells me

RuntimeError: "LayerNormKernelImpl" not implemented for 'Half'

On the advice of a reddit thread I edited webui-user.bat to add

--precision full --no-half

after (on the same line as)

COMMANDLINE_ARGS=

But it didn't make any difference

Install log below, thank you so much :)

Jonathans-MacBook-Pro-2:stable-diffusion-webui taketwotransfer$ ./webui.sh 

################################################################
Install script for stable-diffusion + Web UI
Tested on Debian 11 (Bullseye)
################################################################

################################################################
Running on taketwotransfer user
################################################################

################################################################
Repo already cloned, using it as install directory
################################################################

################################################################
Create and activate python venv
################################################################

################################################################
Launching launch.py...
################################################################
Python 3.10.11 (main, Apr  7 2023, 07:33:52) [Clang 13.0.0 (clang-1300.0.29.30)]
Version: v1.3.1
Commit hash: b6af0a3809ea869fb180633f9affcae4b199ffcf
Installing requirements
Launching Web UI with arguments: --skip-torch-cuda-test --upcast-sampling --no-half-vae --use-cpu interrogate
No module 'xformers'. Proceeding without it.
Warning: caught exception 'Torch not compiled with CUDA enabled', memory monitor disabled
Loading weights [cc6cb27103] from /Users/taketwotransfer/stable-diffusion-webui/models/Stable-diffusion/v1-5-pruned-emaonly.ckpt
Running on local URL:  http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.
Startup time: 3.9s (import torch: 1.0s, import gradio: 1.0s, import ldm: 0.3s, other imports: 0.8s, load scripts: 0.4s, create ui: 0.2s, gradio launch: 0.2s).
Creating model from config: /Users/taketwotransfer/stable-diffusion-webui/configs/v1-inference.yaml
LatentDiffusion: Running in eps-prediction mode
DiffusionWrapper has 859.52 M params.
Applying optimization: InvokeAI... done.
Textual inversion embeddings loaded(0): 
Model loaded in 7.4s (load weights from disk: 1.7s, create model: 0.7s, apply weights to model: 2.3s, apply half(): 2.7s).
Error completing request
Arguments: ('task(bczgk6zge3xri5n)', 'cat', '', [], 20, 0, False, False, 1, 1, 7, -1.0, -1.0, 0, 0, 0, False, 512, 512, False, 0.7, 2, 'Latent', 0, 0, 0, 0, '', '', [], 0, False, False, 'positive', 'comma', 0, False, False, '', 1, '', [], 0, '', [], 0, '', [], True, False, False, False, 0) {}
Traceback (most recent call last):
  File "/Users/taketwotransfer/stable-diffusion-webui/modules/call_queue.py", line 57, in f
    res = list(func(*args, **kwargs))
  File "/Users/taketwotransfer/stable-diffusion-webui/modules/call_queue.py", line 37, in f
    res = func(*args, **kwargs)
  File "/Users/taketwotransfer/stable-diffusion-webui/modules/txt2img.py", line 57, in txt2img
    processed = processing.process_images(p)
  File "/Users/taketwotransfer/stable-diffusion-webui/modules/processing.py", line 610, in process_images
    res = process_images_inner(p)
  File "/Users/taketwotransfer/stable-diffusion-webui/modules/processing.py", line 718, in process_images_inner
    p.setup_conds()
  File "/Users/taketwotransfer/stable-diffusion-webui/modules/processing.py", line 1096, in setup_conds
    super().setup_conds()
  File "/Users/taketwotransfer/stable-diffusion-webui/modules/processing.py", line 337, in setup_conds
    self.uc = self.get_conds_with_caching(prompt_parser.get_learned_conditioning, self.negative_prompts, self.steps * self.step_multiplier, self.cached_uc)
  File "/Users/taketwotransfer/stable-diffusion-webui/modules/processing.py", line 328, in get_conds_with_caching
    cache[1] = function(shared.sd_model, required_prompts, steps)
  File "/Users/taketwotransfer/stable-diffusion-webui/modules/prompt_parser.py", line 143, in get_learned_conditioning
    conds = model.get_learned_conditioning(texts)
  File "/Users/taketwotransfer/stable-diffusion-webui/repositories/stable-diffusion-stability-ai/ldm/models/diffusion/ddpm.py", line 669, in get_learned_conditioning
    c = self.cond_stage_model(c)
  File "/Users/taketwotransfer/stable-diffusion-webui/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1501, in _call_impl
    return forward_call(*args, **kwargs)
  File "/Users/taketwotransfer/stable-diffusion-webui/modules/sd_hijack_clip.py", line 229, in forward
    z = self.process_tokens(tokens, multipliers)
  File "/Users/taketwotransfer/stable-diffusion-webui/modules/sd_hijack_clip.py", line 254, in process_tokens
    z = self.encode_with_transformers(tokens)
  File "/Users/taketwotransfer/stable-diffusion-webui/modules/sd_hijack_clip.py", line 302, in encode_with_transformers
    outputs = self.wrapped.transformer(input_ids=tokens, output_hidden_states=-opts.CLIP_stop_at_last_layers)
  File "/Users/taketwotransfer/stable-diffusion-webui/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1501, in _call_impl
    return forward_call(*args, **kwargs)
  File "/Users/taketwotransfer/stable-diffusion-webui/venv/lib/python3.10/site-packages/transformers/models/clip/modeling_clip.py", line 811, in forward
    return self.text_model(
  File "/Users/taketwotransfer/stable-diffusion-webui/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1501, in _call_impl
    return forward_call(*args, **kwargs)
  File "/Users/taketwotransfer/stable-diffusion-webui/venv/lib/python3.10/site-packages/transformers/models/clip/modeling_clip.py", line 721, in forward
    encoder_outputs = self.encoder(
  File "/Users/taketwotransfer/stable-diffusion-webui/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1501, in _call_impl
    return forward_call(*args, **kwargs)
  File "/Users/taketwotransfer/stable-diffusion-webui/venv/lib/python3.10/site-packages/transformers/models/clip/modeling_clip.py", line 650, in forward
    layer_outputs = encoder_layer(
  File "/Users/taketwotransfer/stable-diffusion-webui/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1501, in _call_impl
    return forward_call(*args, **kwargs)
  File "/Users/taketwotransfer/stable-diffusion-webui/venv/lib/python3.10/site-packages/transformers/models/clip/modeling_clip.py", line 378, in forward
    hidden_states = self.layer_norm1(hidden_states)
  File "/Users/taketwotransfer/stable-diffusion-webui/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1501, in _call_impl
    return forward_call(*args, **kwargs)
  File "/Users/taketwotransfer/stable-diffusion-webui/venv/lib/python3.10/site-packages/torch/nn/modules/normalization.py", line 190, in forward
    return F.layer_norm(
  File "/Users/taketwotransfer/stable-diffusion-webui/venv/lib/python3.10/site-packages/torch/nn/functional.py", line 2515, in layer_norm
    return torch.layer_norm(input, normalized_shape, weight, bias, eps, torch.backends.cudnn.enabled)
RuntimeError: "LayerNormKernelImpl" not implemented for 'Half'

Error completing request
Arguments: ('task(f344t783qxynvnz)', 'cat', '', [], 20, 0, False, False, 1, 1, 7, -1.0, -1.0, 0, 0, 0, False, 512, 512, False, 0.7, 2, 'Latent', 0, 0, 0, 0, '', '', [], 0, False, False, 'positive', 'comma', 0, False, False, '', 1, '', [], 0, '', [], 0, '', [], True, False, False, False, 0) {}
Traceback (most recent call last):
  File "/Users/taketwotransfer/stable-diffusion-webui/modules/call_queue.py", line 57, in f
    res = list(func(*args, **kwargs))
  File "/Users/taketwotransfer/stable-diffusion-webui/modules/call_queue.py", line 37, in f
    res = func(*args, **kwargs)
  File "/Users/taketwotransfer/stable-diffusion-webui/modules/txt2img.py", line 57, in txt2img
    processed = processing.process_images(p)
  File "/Users/taketwotransfer/stable-diffusion-webui/modules/processing.py", line 610, in process_images
    res = process_images_inner(p)
  File "/Users/taketwotransfer/stable-diffusion-webui/modules/processing.py", line 718, in process_images_inner
    p.setup_conds()
  File "/Users/taketwotransfer/stable-diffusion-webui/modules/processing.py", line 1096, in setup_conds
    super().setup_conds()
  File "/Users/taketwotransfer/stable-diffusion-webui/modules/processing.py", line 337, in setup_conds
    self.uc = self.get_conds_with_caching(prompt_parser.get_learned_conditioning, self.negative_prompts, self.steps * self.step_multiplier, self.cached_uc)
  File "/Users/taketwotransfer/stable-diffusion-webui/modules/processing.py", line 328, in get_conds_with_caching
    cache[1] = function(shared.sd_model, required_prompts, steps)
  File "/Users/taketwotransfer/stable-diffusion-webui/modules/prompt_parser.py", line 143, in get_learned_conditioning
    conds = model.get_learned_conditioning(texts)
  File "/Users/taketwotransfer/stable-diffusion-webui/repositories/stable-diffusion-stability-ai/ldm/models/diffusion/ddpm.py", line 669, in get_learned_conditioning
    c = self.cond_stage_model(c)
  File "/Users/taketwotransfer/stable-diffusion-webui/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1501, in _call_impl
    return forward_call(*args, **kwargs)
  File "/Users/taketwotransfer/stable-diffusion-webui/modules/sd_hijack_clip.py", line 229, in forward
    z = self.process_tokens(tokens, multipliers)
  File "/Users/taketwotransfer/stable-diffusion-webui/modules/sd_hijack_clip.py", line 254, in process_tokens
    z = self.encode_with_transformers(tokens)
  File "/Users/taketwotransfer/stable-diffusion-webui/modules/sd_hijack_clip.py", line 302, in encode_with_transformers
    outputs = self.wrapped.transformer(input_ids=tokens, output_hidden_states=-opts.CLIP_stop_at_last_layers)
  File "/Users/taketwotransfer/stable-diffusion-webui/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1501, in _call_impl
    return forward_call(*args, **kwargs)
  File "/Users/taketwotransfer/stable-diffusion-webui/venv/lib/python3.10/site-packages/transformers/models/clip/modeling_clip.py", line 811, in forward
    return self.text_model(
  File "/Users/taketwotransfer/stable-diffusion-webui/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1501, in _call_impl
    return forward_call(*args, **kwargs)
  File "/Users/taketwotransfer/stable-diffusion-webui/venv/lib/python3.10/site-packages/transformers/models/clip/modeling_clip.py", line 721, in forward
    encoder_outputs = self.encoder(
  File "/Users/taketwotransfer/stable-diffusion-webui/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1501, in _call_impl
    return forward_call(*args, **kwargs)
  File "/Users/taketwotransfer/stable-diffusion-webui/venv/lib/python3.10/site-packages/transformers/models/clip/modeling_clip.py", line 650, in forward
    layer_outputs = encoder_layer(
  File "/Users/taketwotransfer/stable-diffusion-webui/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1501, in _call_impl
    return forward_call(*args, **kwargs)
  File "/Users/taketwotransfer/stable-diffusion-webui/venv/lib/python3.10/site-packages/transformers/models/clip/modeling_clip.py", line 378, in forward
    hidden_states = self.layer_norm1(hidden_states)
  File "/Users/taketwotransfer/stable-diffusion-webui/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1501, in _call_impl
    return forward_call(*args, **kwargs)
  File "/Users/taketwotransfer/stable-diffusion-webui/venv/lib/python3.10/site-packages/torch/nn/modules/normalization.py", line 190, in forward
    return F.layer_norm(
  File "/Users/taketwotransfer/stable-diffusion-webui/venv/lib/python3.10/site-packages/torch/nn/functional.py", line 2515, in layer_norm
    return torch.layer_norm(input, normalized_shape, weight, bias, eps, torch.backends.cudnn.enabled)
RuntimeError: "LayerNormKernelImpl" not implemented for 'Half'

[Hermit07]

Yup! Facing same problem. Can it be due to low processing capacity or GPU?

[JonWhitten]

Hey! Got good news and bad news, good news is I can pretty much make it work now! Bad news is it takes forever, massively heats up the computer and there's a bunch of warning messages... see my answer for deets x

[Sakura-Luna]

Are you a Mac but modify the bat file? That's for Windows. You modify an unused entry, which of course has no effect.

Modify the sh file in a similar way.

[JonWhitten]

Thank you! I did, which (as with every step:P) solved some problems and made some new ones. See my answer for deets x

[JonWhitten]

Solved! For... a very loose definition of solved.

When starting it up from terminal, rather than just typing

./webui.sh

I typed

./webui.sh --skip-torch-cuda-test --no-half --use-cpu all

The web ui opens up and I can generate images! The reasons I say it's loosely solved are as below:

• A LOT of warning messages from Terminal - will put up a new discussion thing with them in later
• Extremely slow generation
• Makes my Mac m1 mini really hot. Maybe that's fine? But yes, please proceed carefully anyone reading this

[sojeemud]

This fixed my issue as well. Thanks!

Is this just because my Mac isn't powerful enough to run with the default command? Hence the overheating and warning messages?