How to install A1111 on MacOS (step by step guide)

[viking1304]

March 17th 2024 version

UPDATE:

IMPORTANT NOTE - since the macOS 14.4 update, in combination with PyTorch 2.2.0 and newer, breaks some samplers like Euler A, DPM++ 2S A and some others, PyTorch 2.1.2 should be used.

If you want to install a1111 or fix your current a1111 install as fast as possible, just use my a1111-setup script that will do everything for you.

Simply run bash a1111-setup.sh or chmod 755 a1111-setup.sh && ./a1111-setup.sh. Wait a few minutes (depending on your computer and internet speed) until you see WebUI opened in your default browser.

I have also added a few command line parameters:

      [-t recommended|stable|develop] recommended, stable or develop version of PyTorch
      [-f all|errors|none] apply all fixes, only fixes for errors or none
      [-d folder_name] specify the destination folder for A1111 installation
      [-o a1111|forge] install A1111 or Forge
      [-b] update Homebrew
      [-h] display help

Of course, you can still use this step-by-step guide if you want full control.

Step by step guide

This guide uses the best command line settings I could find after a lot of experimenting. It also solves all the errors I experienced with A1111. It is based on the original post from this thread. I am just posting everything together for easier access to proper and updated information.

It was tested and has been working without a problem on those Mac models:

• MacBook Pro 14" M3 Pro (2023) with 18GB of RAM
• MacBook Pro 13.3" M1 (2021) with 16GB of RAM
• iMac 5K (2019) with 16GB of RAM and Raden Pro 580X 8 GB

DO NOT try to install the AMD version on iMacs with Radeon since Mac uses Metal even for Radeon Cards

New install:

1. If Homebrew is not installed, follow the instructions at https://brew.sh to install it. Keep the terminal window open and follow the instructions under "Next steps" to add Homebrew to your PATH

2. Open a new terminal window and run brew install cmake protobuf rust python@3.10 git wget

3. Type cd to be sure that you are in your home folder

4. Clone the web UI repository by running git clone https://github.com/AUTOMATIC1111/stable-diffusion-webui

5. Optional step - place Stable Diffusion models/checkpoints you want to use into stable-diffusion-webui/models/Stable-diffusion. If you skip this step, the default model will be downloaded.

6. Optional step - A1111 v1.8.0 introduced some breaking changes, which might affect clean installations of A1111. If you just installed A1111 and plan to use Controlnet, please do those additional steps:

   • Install protbuf venv/bin/pip install protobuf==3.20.3
   • Install insightface venv/bin/pip install insightface==0.7.3

Existing install:

1. Go to the stable-diffusion-webui folder using cd stable-diffusion-webui

2. Use git reset --hard origin/master to remove local changes of AUTOMATIC1111 files

3. Use git pull to update to the latest version of AUTOMATIC1111

4. Run venv/bin/pip cache purge to clean pip’s wheel cache

5. Remove venv folder with rm -rf venv or using Finder.

Common steps:

1. Please check if you still have venv folder inside your stable diffusion folder. If you have it, please go back to the Existing install part and do everything from that part fist

2. Open webui-user.sh, find this line

   #export TORCH_COMMAND="pip install torch==1.12.1+cu113 --extra-index-url https://download.pytorch.org/whl/cu113"
   

   and add the line below to use PyTorch 2.1.2

   export TORCH_COMMAND="pip install torch==2.1.2 torchvision==0.16.2"
   

3. In the same file, find this line

   #export COMMANDLINE_ARGS=""
   

   and add the line below to use the recommended command line parameters for Mac

   export COMMANDLINE_ARGS="--skip-torch-cuda-test --opt-sub-quad-attention --upcast-sampling --no-half-vae --medvram-sdxl --use-cpu interrogate"
   

4. Your webui-user.sh should look like this:

   #!/bin/bash
   #########################################################
   # Uncomment and change the variables below to your need:#
   #########################################################
   
   # Install directory without trailing slash
   #install_dir="/home/$(whoami)"
   
   # Name of the subdirectory
   #clone_dir="stable-diffusion-webui"
   
   # Commandline arguments for webui.py, for example: export COMMANDLINE_ARGS="--medvram --opt-split-attention"
   #export COMMANDLINE_ARGS=""
   export COMMANDLINE_ARGS="--skip-torch-cuda-test --opt-sub-quad-attention --upcast-sampling --no-half-vae --medvram-sdxl --use-cpu interrogate"
   
   # python3 executable
   #python_cmd="python3"
   
   # git executable
   #export GIT="git"
   
   # python3 venv without trailing slash (defaults to ${install_dir}/${clone_dir}/venv)
   #venv_dir="venv"
   
   # script to launch to start the app
   #export LAUNCH_SCRIPT="launch.py"
   
   # install command for torch
   #export TORCH_COMMAND="pip install torch==1.12.1+cu113 --extra-index-url https://download.pytorch.org/whl/cu113"
   export TORCH_COMMAND="pip install torch==2.1.2 torchvision==0.16.2"
   
   # Requirements file to use for stable-diffusion-webui
   #export REQS_FILE="requirements_versions.txt"
   
   # Fixed git repos
   #export K_DIFFUSION_PACKAGE=""
   #export GFPGAN_PACKAGE=""
   
   # Fixed git commits
   #export STABLE_DIFFUSION_COMMIT_HASH=""
   #export CODEFORMER_COMMIT_HASH=""
   #export BLIP_COMMIT_HASH=""
   
   # Uncomment to enable accelerated launch
   #export ACCELERATE="True"
   
   # Uncomment to disable TCMalloc
   #export NO_TCMALLOC="True"
   
   ###########################################

   Note: Do not edit webui.sh or webui-macos-env.sh

5. Since some models might give you this error

   TypeError: Cannot convert a MPS Tensor to float64 dtype as the MPS framework doesn't support float64. Please use float32 instead.

   run this command to fix that error in advance

   sed -i '' "/^                    dtype = sd_param.dtype if sd_param is not None else param.dtype/,/^ *[^:]*:/s/module._parameters\[name\] = torch.nn.parameter.Parameter/if dtype == torch.float64 and device.type == 'mps':\n                      dtype = torch.float32\n                    module._parameters\[name\] = torch.nn.parameter.Parameter/" modules/sd_disable_initialization.py
   

6. Run ./webui.sh. A new Python virtual environment will be created and activated using venv and all missing dependencies will be automatically downloaded and installed. Web UI will be launched automatically at the end

Additional notes:

To relaunch the web UI process later, run ./webui.sh again. To update, run git pull before running ./webui.sh

In some cases, default command line parameters provided by the A1111 team are not the best choice, and in some rare cases, they do not work.

You can try and see which of the command line parameters below works the best for you.

Args for Macs implemented by the A1111 team:

export COMMANDLINE_ARGS="--skip-torch-cuda-test --upcast-sampling --no-half-vae --use-cpu interrogate"

My recommendation for most Macs:

export COMMANDLINE_ARGS="--skip-torch-cuda-test --opt-sub-quad-attention --upcast-sampling --no-half-vae --medvram-sdxl --use-cpu interrogate"

For special cases when --no-half-vae produce only noise:

export COMMANDLINE_ARGS="--skip-torch-cuda-test --upcast-sampling --no-half --use-cpu interrogate"
export COMMANDLINE_ARGS="--skip-torch-cuda-test --opt-sub-quad-attention --upcast-sampling --no-half --medvram-sdxl"

Those combinations also worked without error on my Macs:

export COMMANDLINE_ARGS="--skip-torch-cuda-test --opt-split-attention-v1 --opt-sub-quad-attention --upcast-sampling --no-half-vae --medvram-sdxl"
export COMMANDLINE_ARGS="--skip-torch-cuda-test --upcast-sampling --no-half-vae --medvram-sdxl"
export COMMANDLINE_ARGS="--skip-torch-cuda-test --opt-split-attention-v1 --upcast-sampling --no-half-vae --medvram-sdxl"
export COMMANDLINE_ARGS="--skip-torch-cuda-test --opt-sub-quad-attention --upcast-sampling --no-half-vae --medvram"

[creativehelm]

I'm having an issue where I launch with ./webui.sh but it won't use the virtual environment, even if I explicitly activate the virtual environment with source /stable-diffusion-webui/venv/bin/activate.

There's definitely a 'venv' in the directory: ~/stable-diffusion-webui_dev/stable-diffusion-webui/venv

But the installation just wanted to use my Homebrew's installation of Python and my system's PyTorch (2.1.2).

I'm using pyenv to manage Python for my system (macOS Sonoma 14.4.1, M3 Max)—could that be causing the problem?

Any help would be much appreciated.

[mclaughlin111]

Hi, thank you for uploading this tool and instruction. After a fresh install using your tool, I am still getting this error: AttributeError: 'NoneType' object has no attribute 'lowvram'

(AUTOMATIC1111/stable-diffusion-webui#15793)

What troubleshooting steps do you suggest?

[viking1304]

Run this command and post the output:

system_profiler SPHardwareDataType | head -n 12 && echo "" && system_profiler SPDisplaysDataType && sw_vers

Double-check if your serial is displayed in the output before posting!

I am not 100% sure if other macOS versions have the same display format as the last one, but the serial should not be in the first 12 lines of SPHardwareDataType output.

Also, post the result of this command:

echo -e "\nInstalled python versions:";for v in {10..12}; do if command -v python3."${v}" &> /dev/null;then python_version="$(python3."${v}" --version)";python_path="$(which python3."${v}")";echo -e "  \033[34m${python_version#*[[:space:]]}\033[0m: ${python_path}";fi;done;if command -v python3 &> /dev/null;then p3="$(python3 --version)";echo -e "\nDefault Python version: \033[34m${p3#*[[:space:]]}\033[0m";fi

[JohnWolf]

Thanks for the script, installation went without issues using the 0.1.0 script from 3 weeks ago. I have used A1111 some on PC, and decided it was time to try on MacOS.

Running on Sonoma 14.4.1 on M3 Max w/36GB RAM, I've found that several of the sampling methods produce only static. To test, I'm just using the base 1.5 pruned. These samplers produce just static:
Euler
Euler a
LMS
Heun

I've tried a few variations of the command line args based on the mention of noise results, but those apparently were just for gpus on intel.

Any suggestions on how to proceed? Should I try a different version of PyTorch?

Also, does xformers work on arm macs? I'm getting conflicting information as I thought xformers was nvidia only, but some places mention it running on arm too.

EDIT: OK, I'm not sure what fixed it, but I thought maybe it would be best to use the recommended Python version, so I backed down from 3.12 to 3.10.9.

Maybe it was coincidence, but launching webui.sh, it downloaded a new torch nightly version, and the broken samplers are working.

I assume once 2.4 is stable, we can switch from nightly to stable?

[viking1304]

Python 3.10.x is recommended by developers, but 3.11 should also work (but I do not recommend it). 3.12 does not work at all. You can use PyTorch v2.3 or 2.4dev (nightly).

I will release a new version of the installer soon (probably next week), but I need to figure out what is the best solution for Intel Macs first since PyTorch dropped support for those with v2.3.

[JohnWolf]

Thanks for the follow-up. In the updated script, could it warn of incorrect python version and how to correct it? I'm still trying to wrap my head around what version of python will be used by a1111. Brew keeps installing the latest version, which I guess doesn't matter as it isn't in the shell path. The DMG version of python (I chose 3.10.9) is apparently the one to take precedent.

Something else the script may want to address is the python certificates. Without the certs installed, it appears you can't use some (all?) SDXL models.

[viking1304]

My script will install the latest version of python3.10 and other prerequisites using brew, so there is no need to install anything manually. Script will even install brew itself if it is not installed. A1111 has a script that detects macOS and forces python3.10.

In most cases problem occurs if the default python3 is 3.12 and 3.10 is manually installed and not in the path. You should not have a problem with the wrong python version if you are using my script and do not have any manually installed python versions.

I could add the code to check if python3.10 will be detected by a1111 and throw an error if needed. I could also show a list of all detected python installations. But, I think that this detection should happen on a1111 itself. I will think about it and see if I will add a check to my script or make another PR to A1111. Let's see will they accept my current PR for different torch versions for Intel and ARM. I do not want to have two PRs that will change the same file at the same time.

Please post the result of this command:

echo -e "\nInstalled python versions:";for v in {10..12}; do if command -v python3."${v}" &> /dev/null;then python_version="$(python3."${v}" --version)";python_path="$(which python3."${v}")";echo -e "  \033[34m${python_version#*[[:space:]]}\033[0m: ${python_path}";fi;done;if command -v python3 &> /dev/null;then p3="$(python3 --version)";echo -e "\nDefault Python version: \033[34m${p3#*[[:space:]]}\033[0m";fi

[JohnWolf]

Installed python versions:
  3.10.9: /Library/Frameworks/Python.framework/Versions/3.10/bin/python3.10

Default Python version: 3.10.9

I think where the confusion set in is that I had installed the most recent 3.12 Python DMG from Python.org for another project and promptly forgot about it. Then when using your script, I didn't realize that when I was downgrading the brew version from 3.12 to 3.10, it wasn't fixing the issues with A1111. I had just made the assumption that the brew version was going to be used until realizing I hand't looked at my path. (I have since replaced the 3.12.2 dmg with the 3.10.9 dmg and all is well.)

Just FYI:

% which -a python3

/Library/Frameworks/Python.framework/Versions/3.10/bin/python3
/usr/local/bin/python3
/usr/bin/python3

[klnq]

awesome script, thanks for making it! installing Forge with it significantly reduced time for image generation. but only for SD 1.5 models, SDXL models loading time is approx minute, moving takes around same time and 512x512px 20 steps image generation takes around 40 min. is there anything possible to get SDXL model working faster or just stick to SD 1.5?

[klnq]

Thanks for reply! I later also discovered that configuration (webui-user.sh) coming with installation was working only with 512x512 images. Anything above, even 768x768 on SD1.5 was causing Mac to freeze. I looked in some threads/forums for info, changing configuration to what it is now in log have solved this issue. 512x512 20 steps images are generated in less than minute, 1024x1024 20 steps is taking around 3-5 minutes.
SDXL checkpoints are still taking a lot of time. Generating even 512x512 20 step images takes more then 20 min per image.

System info:
Model Name: Mac mini
Chip: Apple M2
Total Number of Cores: 8 (4 performance and 4 efficiency)
Memory: 8 GB
System Version: macOS 14.4.1 (23E224)

Times for SD/SDXL 512x512 20 step image generations (simple prompt: Photo, Red apple on wooden table, outdoors):
eXcursion SD1.5
Time taken: 32.4 sec.

Dream shaper SD1.5
Time taken: 36.5 sec.

Dream shaper SDXL
Time taken: 15 min. 48.8 sec.
epiCRealism XL
Time taken: 21 min. 58.4 sec.

Log from terminal
WEBUI LOG

(base) UserName@Mac GenAI % cd Forge
(base) UserName@Mac Forge % ./webui.sh

################################################################
Install script for stable-diffusion + Web UI
Tested on Debian 11 (Bullseye), Fedora 34+ and openSUSE Leap 15.4 or newer.
################################################################

################################################################
Running on UserName user
################################################################

################################################################
Repo already cloned, using it as install directory
################################################################

################################################################
Create and activate python venv
################################################################

################################################################
Launching launch.py...
################################################################
Python 3.10.14 (main, Mar 19 2024, 21:46:16) [Clang 15.0.0 (clang-1500.3.9.4)]
Version: f0.0.17v1.8.0rc-latest-276-g29be1da7
Commit hash: 29be1da7cf2b5dccfc70fbdd33eb35c56a31ffb7
Legacy Preprocessor init warning: Unable to install insightface automatically. Please try run pip install insightface manually.
Launching Web UI with arguments: --opt-split-attention-v1 --skip-torch-cuda-test --all-in-fp16 --always-offload-from-vram --no-half --use-cpu all --theme dark --ckpt-dir /Users/UserName/GenAI/z_Models/checkpoints --lora-dir /Users/UserName/GenAI/z_Models/loras
Total VRAM 8192 MB, total RAM 8192 MB
Forcing FP16.
Set vram state to: SHARED
Always offload VRAM
Device: mps
VAE dtype: torch.float32
CUDA Stream Activated: False
Warning: caught exception 'Torch not compiled with CUDA enabled', memory monitor disabled
Using sub quadratic optimization for cross attention, if you have memory or speed issues try using: --attention-split
ControlNet preprocessor location: /Users/UserName/GenAI/Forge/models/ControlNetPreprocessor
Loading weights [4631aa5830] from /Users/UserName/GenAI/z_Models/checkpoints/excursion_v10.safetensors
2024-04-17 16:42:00,820 - ControlNet - INFO - ControlNet UI callback registered.
Running on local URL: http://127.0.0.1:7860

To create a public link, set share=True in launch().
model_type EPS
UNet ADM Dimension 0
Startup time: 5.7s (prepare environment: 0.3s, import torch: 2.0s, import gradio: 0.5s, setup paths: 0.7s, other imports: 0.6s, load scripts: 0.7s, create ui: 0.4s, gradio launch: 0.3s).
Using split attention in VAE
Working with z of shape (1, 4, 32, 32) = 4096 dimensions.
Using split attention in VAE
extra {'cond_stage_model.clip_l.logit_scale', 'cond_stage_model.clip_l.text_projection'}
left over keys: dict_keys(['alphas_cumprod', 'alphas_cumprod_prev', 'betas', 'decoder.conv_in.bias', 'decoder.conv_in.weight', 'decoder.conv_out.bias', 'decoder.conv_out.weight', 'decoder.mid.attn_1.k.bias', 'decoder.mid.attn_1.k.weight', 'decoder.mid.attn_1.norm.bias', 'decoder.mid.attn_1.norm.weight', 'decoder.mid.attn_1.proj_out.bias', 'decoder.mid.attn_1.proj_out.weight', 'decoder.mid.attn_1.q.bias', 'decoder.mid.attn_1.q.weight', 'decoder.mid.attn_1.v.bias', 'decoder.mid.attn_1.v.weight', 'decoder.mid.block_1.conv1.bias', 'decoder.mid.block_1.conv1.weight', 'decoder.mid.block_1.conv2.bias', 'decoder.mid.block_1.conv2.weight', 'decoder.mid.block_1.norm1.bias', 'decoder.mid.block_1.norm1.weight', 'decoder.mid.block_1.norm2.bias', 'decoder.mid.block_1.norm2.weight', 'decoder.mid.block_2.conv1.bias', 'decoder.mid.block_2.conv1.weight', 'decoder.mid.block_2.conv2.bias', 'decoder.mid.block_2.conv2.weight', 'decoder.mid.block_2.norm1.bias', 'decoder.mid.block_2.norm1.weight', 'decoder.mid.block_2.norm2.bias', 'decoder.mid.block_2.norm2.weight', 'decoder.norm_out.bias', 'decoder.norm_out.weight', 'decoder.up.0.block.0.conv1.bias', 'decoder.up.0.block.0.conv1.weight', 'decoder.up.0.block.0.conv2.bias', 'decoder.up.0.block.0.conv2.weight', 'decoder.up.0.block.0.nin_shortcut.bias', 'decoder.up.0.block.0.nin_shortcut.weight', 'decoder.up.0.block.0.norm1.bias', 'decoder.up.0.block.0.norm1.weight', 'decoder.up.0.block.0.norm2.bias', 'decoder.up.0.block.0.norm2.weight', 'decoder.up.0.block.1.conv1.bias', 'decoder.up.0.block.1.conv1.weight', 'decoder.up.0.block.1.conv2.bias', 'decoder.up.0.block.1.conv2.weight', 'decoder.up.0.block.1.norm1.bias', 'decoder.up.0.block.1.norm1.weight', 'decoder.up.0.block.1.norm2.bias', 'decoder.up.0.block.1.norm2.weight', 'decoder.up.0.block.2.conv1.bias', 'decoder.up.0.block.2.conv1.weight', 'decoder.up.0.block.2.conv2.bias', 'decoder.up.0.block.2.conv2.weight', 'decoder.up.0.block.2.norm1.bias', 'decoder.up.0.block.2.norm1.weight', 'decoder.up.0.block.2.norm2.bias', 'decoder.up.0.block.2.norm2.weight', 'decoder.up.1.block.0.conv1.bias', 'decoder.up.1.block.0.conv1.weight', 'decoder.up.1.block.0.conv2.bias', 'decoder.up.1.block.0.conv2.weight', 'decoder.up.1.block.0.nin_shortcut.bias', 'decoder.up.1.block.0.nin_shortcut.weight', 'decoder.up.1.block.0.norm1.bias', 'decoder.up.1.block.0.norm1.weight', 'decoder.up.1.block.0.norm2.bias', 'decoder.up.1.block.0.norm2.weight', 'decoder.up.1.block.1.conv1.bias', 'decoder.up.1.block.1.conv1.weight', 'decoder.up.1.block.1.conv2.bias', 'decoder.up.1.block.1.conv2.weight', 'decoder.up.1.block.1.norm1.bias', 'decoder.up.1.block.1.norm1.weight', 'decoder.up.1.block.1.norm2.bias', 'decoder.up.1.block.1.norm2.weight', 'decoder.up.1.block.2.conv1.bias', 'decoder.up.1.block.2.conv1.weight', 'decoder.up.1.block.2.conv2.bias', 'decoder.up.1.block.2.conv2.weight', 'decoder.up.1.block.2.norm1.bias', 'decoder.up.1.block.2.norm1.weight', 'decoder.up.1.block.2.norm2.bias', 'decoder.up.1.block.2.norm2.weight', 'decoder.up.1.upsample.conv.bias', 'decoder.up.1.upsample.conv.weight', 'decoder.up.2.block.0.conv1.bias', 'decoder.up.2.block.0.conv1.weight', 'decoder.up.2.block.0.conv2.bias', 'decoder.up.2.block.0.conv2.weight', 'decoder.up.2.block.0.norm1.bias', 'decoder.up.2.block.0.norm1.weight', 'decoder.up.2.block.0.norm2.bias', 'decoder.up.2.block.0.norm2.weight', 'decoder.up.2.block.1.conv1.bias', 'decoder.up.2.block.1.conv1.weight', 'decoder.up.2.block.1.conv2.bias', 'decoder.up.2.block.1.conv2.weight', 'decoder.up.2.block.1.norm1.bias', 'decoder.up.2.block.1.norm1.weight', 'decoder.up.2.block.1.norm2.bias', 'decoder.up.2.block.1.norm2.weight', 'decoder.up.2.block.2.conv1.bias', 'decoder.up.2.block.2.conv1.weight', 'decoder.up.2.block.2.conv2.bias', 'decoder.up.2.block.2.conv2.weight', 'decoder.up.2.block.2.norm1.bias', 'decoder.up.2.block.2.norm1.weight', 'decoder.up.2.block.2.norm2.bias', 'decoder.up.2.block.2.norm2.weight', 'decoder.up.2.upsample.conv.bias', 'decoder.up.2.upsample.conv.weight', 'decoder.up.3.block.0.conv1.bias', 'decoder.up.3.block.0.conv1.weight', 'decoder.up.3.block.0.conv2.bias', 'decoder.up.3.block.0.conv2.weight', 'decoder.up.3.block.0.norm1.bias', 'decoder.up.3.block.0.norm1.weight', 'decoder.up.3.block.0.norm2.bias', 'decoder.up.3.block.0.norm2.weight', 'decoder.up.3.block.1.conv1.bias', 'decoder.up.3.block.1.conv1.weight', 'decoder.up.3.block.1.conv2.bias', 'decoder.up.3.block.1.conv2.weight', 'decoder.up.3.block.1.norm1.bias', 'decoder.up.3.block.1.norm1.weight', 'decoder.up.3.block.1.norm2.bias', 'decoder.up.3.block.1.norm2.weight', 'decoder.up.3.block.2.conv1.bias', 'decoder.up.3.block.2.conv1.weight', 'decoder.up.3.block.2.conv2.bias', 'decoder.up.3.block.2.conv2.weight', 'decoder.up.3.block.2.norm1.bias', 'decoder.up.3.block.2.norm1.weight', 'decoder.up.3.block.2.norm2.bias', 'decoder.up.3.block.2.norm2.weight', 'decoder.up.3.upsample.conv.bias', 'decoder.up.3.upsample.conv.weight', 'encoder.conv_in.bias', 'encoder.conv_in.weight', 'encoder.conv_out.bias', 'encoder.conv_out.weight', 'encoder.down.0.block.0.conv1.bias', 'encoder.down.0.block.0.conv1.weight', 'encoder.down.0.block.0.conv2.bias', 'encoder.down.0.block.0.conv2.weight', 'encoder.down.0.block.0.norm1.bias', 'encoder.down.0.block.0.norm1.weight', 'encoder.down.0.block.0.norm2.bias', 'encoder.down.0.block.0.norm2.weight', 'encoder.down.0.block.1.conv1.bias', 'encoder.down.0.block.1.conv1.weight', 'encoder.down.0.block.1.conv2.bias', 'encoder.down.0.block.1.conv2.weight', 'encoder.down.0.block.1.norm1.bias', 'encoder.down.0.block.1.norm1.weight', 'encoder.down.0.block.1.norm2.bias', 'encoder.down.0.block.1.norm2.weight', 'encoder.down.0.downsample.conv.bias', 'encoder.down.0.downsample.conv.weight', 'encoder.down.1.block.0.conv1.bias', 'encoder.down.1.block.0.conv1.weight', 'encoder.down.1.block.0.conv2.bias', 'encoder.down.1.block.0.conv2.weight', 'encoder.down.1.block.0.nin_shortcut.bias', 'encoder.down.1.block.0.nin_shortcut.weight', 'encoder.down.1.block.0.norm1.bias', 'encoder.down.1.block.0.norm1.weight', 'encoder.down.1.block.0.norm2.bias', 'encoder.down.1.block.0.norm2.weight', 'encoder.down.1.block.1.conv1.bias', 'encoder.down.1.block.1.conv1.weight', 'encoder.down.1.block.1.conv2.bias', 'encoder.down.1.block.1.conv2.weight', 'encoder.down.1.block.1.norm1.bias', 'encoder.down.1.block.1.norm1.weight', 'encoder.down.1.block.1.norm2.bias', 'encoder.down.1.block.1.norm2.weight', 'encoder.down.1.downsample.conv.bias', 'encoder.down.1.downsample.conv.weight', 'encoder.down.2.block.0.conv1.bias', 'encoder.down.2.block.0.conv1.weight', 'encoder.down.2.block.0.conv2.bias', 'encoder.down.2.block.0.conv2.weight', 'encoder.down.2.block.0.nin_shortcut.bias', 'encoder.down.2.block.0.nin_shortcut.weight', 'encoder.down.2.block.0.norm1.bias', 'encoder.down.2.block.0.norm1.weight', 'encoder.down.2.block.0.norm2.bias', 'encoder.down.2.block.0.norm2.weight', 'encoder.down.2.block.1.conv1.bias', 'encoder.down.2.block.1.conv1.weight', 'encoder.down.2.block.1.conv2.bias', 'encoder.down.2.block.1.conv2.weight', 'encoder.down.2.block.1.norm1.bias', 'encoder.down.2.block.1.norm1.weight', 'encoder.down.2.block.1.norm2.bias', 'encoder.down.2.block.1.norm2.weight', 'encoder.down.2.downsample.conv.bias', 'encoder.down.2.downsample.conv.weight', 'encoder.down.3.block.0.conv1.bias', 'encoder.down.3.block.0.conv1.weight', 'encoder.down.3.block.0.conv2.bias', 'encoder.down.3.block.0.conv2.weight', 'encoder.down.3.block.0.norm1.bias', 'encoder.down.3.block.0.norm1.weight', 'encoder.down.3.block.0.norm2.bias', 'encoder.down.3.block.0.norm2.weight', 'encoder.down.3.block.1.conv1.bias', 'encoder.down.3.block.1.conv1.weight', 'encoder.down.3.block.1.conv2.bias', 'encoder.down.3.block.1.conv2.weight', 'encoder.down.3.block.1.norm1.bias', 'encoder.down.3.block.1.norm1.weight', 'encoder.down.3.block.1.norm2.bias', 'encoder.down.3.block.1.norm2.weight', 'encoder.mid.attn_1.k.bias', 'encoder.mid.attn_1.k.weight', 'encoder.mid.attn_1.norm.bias', 'encoder.mid.attn_1.norm.weight', 'encoder.mid.attn_1.proj_out.bias', 'encoder.mid.attn_1.proj_out.weight', 'encoder.mid.attn_1.q.bias', 'encoder.mid.attn_1.q.weight', 'encoder.mid.attn_1.v.bias', 'encoder.mid.attn_1.v.weight', 'encoder.mid.block_1.conv1.bias', 'encoder.mid.block_1.conv1.weight', 'encoder.mid.block_1.conv2.bias', 'encoder.mid.block_1.conv2.weight', 'encoder.mid.block_1.norm1.bias', 'encoder.mid.block_1.norm1.weight', 'encoder.mid.block_1.norm2.bias', 'encoder.mid.block_1.norm2.weight', 'encoder.mid.block_2.conv1.bias', 'encoder.mid.block_2.conv1.weight', 'encoder.mid.block_2.conv2.bias', 'encoder.mid.block_2.conv2.weight', 'encoder.mid.block_2.norm1.bias', 'encoder.mid.block_2.norm1.weight', 'encoder.mid.block_2.norm2.bias', 'encoder.mid.block_2.norm2.weight', 'encoder.norm_out.bias', 'encoder.norm_out.weight', 'log_one_minus_alphas_cumprod', 'post_quant_conv.bias', 'post_quant_conv.weight', 'posterior_log_variance_clipped', 'posterior_mean_coef1', 'posterior_mean_coef2', 'posterior_variance', 'quant_conv.bias', 'quant_conv.weight', 'sqrt_alphas_cumprod', 'sqrt_one_minus_alphas_cumprod', 'sqrt_recip_alphas_cumprod', 'sqrt_recipm1_alphas_cumprod'])
To load target model SD1ClipModel
Begin to load 1 model
Moving model(s) has taken 0.00 seconds
Model loaded in 5.0s (load weights from disk: 0.5s, forge load real models: 4.1s, calculate empty prompt: 0.4s).
To load target model BaseModel
Begin to load 1 model
Moving model(s) has taken 0.90 seconds
100%|███████████████████████████████████████████| 20/20 [00:27<00:00, 1.36s/it]
To load target model AutoencoderKL██████████████| 20/20 [00:25<00:00, 1.35s/it]
Begin to load 1 model
Moving model(s) has taken 2.53 seconds
Total progress: 100%|███████████████████████████| 20/20 [00:29<00:00, 1.49s/it]
Loading weights [879db523c3] from /Users/UserName/GenAI/z_Models/checkpoints/dreamshaper_8.safetensors
model_type EPS
UNet ADM Dimension 0
Using split attention in VAE
Working with z of shape (1, 4, 32, 32) = 4096 dimensions.
Using split attention in VAE
extra {'cond_stage_model.clip_l.logit_scale', 'cond_stage_model.clip_l.text_projection'}
To load target model SD1ClipModel
Begin to load 1 model
Moving model(s) has taken 0.00 seconds
Model loaded in 10.4s (unload existing model: 0.6s, forge load real models: 9.2s, calculate empty prompt: 0.5s).
To load target model BaseModel
Begin to load 1 model
Moving model(s) has taken 0.69 seconds
100%|███████████████████████████████████████████| 20/20 [00:27<00:00, 1.37s/it]
To load target model AutoencoderKL██████████████| 20/20 [00:26<00:00, 1.35s/it]
Begin to load 1 model
Moving model(s) has taken 2.49 seconds
Total progress: 100%|███████████████████████████| 20/20 [00:30<00:00, 1.51s/it]
Loading weights [4496b36d48] from /Users/UserName/GenAI/z_Models/checkpoints/dreamshaperXL_v21TurboDPMSDE.safetensors
model_type EPS
UNet ADM Dimension 2816
Using split attention in VAE
Working with z of shape (1, 4, 32, 32) = 4096 dimensions.
Using split attention in VAE
extra {'cond_stage_model.clip_l.logit_scale', 'cond_stage_model.clip_g.transformer.text_model.embeddings.position_ids', 'cond_stage_model.clip_l.text_projection', 'cond_stage_model.clip_l.transformer.text_model.embeddings.position_ids'}
left over keys: dict_keys(['conditioner.embedders.0.logit_scale', 'conditioner.embedders.0.text_projection'])
To load target model SDXLClipModel
Begin to load 1 model
Moving model(s) has taken 0.01 seconds
Model loaded in 39.3s (unload existing model: 0.7s, load weights from disk: 0.2s, forge load real models: 28.9s, calculate empty prompt: 9.2s).
To load target model SDXL
Begin to load 1 model
Moving model(s) has taken 65.75 seconds
100%|███████████████████████████████████████████| 20/20 [13:15<00:00, 39.76s/it]
To load target model AutoencoderKL██████████████| 20/20 [12:38<00:00, 41.66s/it]
Begin to load 1 model
Moving model(s) has taken 49.53 seconds
Total progress: 100%|███████████████████████████| 20/20 [13:29<00:00, 40.46s/it]
Loading weights [7263d2b958] from /Users/UserName/GenAI/z_Models/checkpoints/epicrealismXL_v5Ultimate.safetensors
model_type EPS
UNet ADM Dimension 2816
Using split attention in VAE
Working with z of shape (1, 4, 32, 32) = 4096 dimensions.
Using split attention in VAE
extra {'cond_stage_model.clip_l.logit_scale', 'cond_stage_model.clip_g.transformer.text_model.embeddings.position_ids', 'cond_stage_model.clip_l.text_projection'}
left over keys: dict_keys(['conditioner.embedders.0.logit_scale', 'conditioner.embedders.0.text_projection'])
To load target model SDXLClipModel
Begin to load 1 model
Moving model(s) has taken 0.00 seconds
Model loaded in 42.4s (unload existing model: 0.8s, load weights from disk: 0.5s, forge load real models: 33.3s, calculate empty prompt: 7.5s).
To load target model SDXL
Begin to load 1 model
Moving model(s) has taken 63.58 seconds
100%|███████████████████████████████████████████| 20/20 [19:24<00:00, 58.20s/it]
To load target model AutoencoderKL██████████████| 20/20 [18:36<00:00, 58.08s/it]
Begin to load 1 model
Moving model(s) has taken 67.27 seconds
Total progress: 100%|███████████████████████████| 20/20 [19:45<00:00, 59.29s/it]
To load target model SDXL███████████████████████| 20/20 [19:45<00:00, 58.08s/it]
Begin to load 1 model
Moving model(s) has taken 58.22 seconds
100%|███████████████████████████████████████████| 20/20 [17:20<00:00, 52.00s/it]
To load target model AutoencoderKL████████████▋ | 19/20 [16:38<00:57, 57.58s/it]
Begin to load 1 model
Moving model(s) has taken 70.07 seconds
Total progress: 100%|███████████████████████████| 20/20 [17:50<00:00, 53.52s/it]

[viking1304]

Do not use --no-half --use-cpu all. That will just make things slower.

Try this instead: --skip-torch-cuda-test --attention-pytorch --all-in-fp16 --always-offload-from-vram --theme dark --ckpt-dir /Users/UserName/GenAI/z_Models/checkpoints --lora-dir /Users/UserName/GenAI/z_Models/loras

[klnq]

Unfortunately with this configuration SDXL model still takes more than 20 min to generate 512x512 image:

To load target model SDXLClipModel
Begin to load 1 model
Moving model(s) has taken 0.01 seconds
Model loaded in 42.6s (unload existing model: 0.2s, calculate hash: 4.2s, load weights from disk: 0.2s, forge load real models: 35.3s, calculate empty prompt: 2.5s).
To load target model SDXL
Begin to load 1 model
Moving model(s) has taken 69.62 seconds
100%|████████████████████████████████████████████| 8/8 [22:47<00:00, 170.96s/it]
To load target model AutoencoderKL███████████████| 8/8 [21:02<00:00, 172.39s/it]

[viking1304]

Your main problem is RAM. I think you should stick with 1.5, and try lightning since it can generate good images in fewer steps (like 4 or 8). Also, do not use 512x512 with SDXL (except with turbo). Use 768x768, 1024x1024, 1024x768 or 768x1024.

For params, try this as suggested in your previous log:
Using sub quadratic optimization for cross attention, if you have memory or speed issues try using: --attention-split

--skip-torch-cuda-test --attention-split --all-in-fp16 --always-offload-from-vram --theme dark --ckpt-dir /Users/UserName/GenAI/z_Models/checkpoints --lora-dir /Users/UserName/GenAI/z_Models/loras

and also this

--skip-torch-cuda-test --all-in-fp16 --always-offload-from-vram --theme dark --ckpt-dir /Users/UserName/GenAI/z_Models/checkpoints --lora-dir /Users/UserName/GenAI/z_Models/loras

[klnq]

Thanks! No luck with this settings and suggestion too. Will stick to sd1.5 for now

[XorPhyson]

Thanks a lot for the helpful script. How do I proceed with an update?

git pull says "You are not currently on a branch."

Do I run the script again? Will the directories with the stable diffusion models and the generated images retained?

[viking1304]

That sounds strange. What does git status and git log show?

Yes, you can rerun the script, and it should fix everything. Just be sure to use the latest version since something new and strange happens constantly.

It will not touch your models, loras or extensions, but it will remove your venv folder, and a1111 will create a new one.

The only thing that might need to be changed manually later would be command-line parameters in webui-user.sh, since it will be reset to default. If you want to use my params (that works best for me) instead of the default ones, run the script like this
bash a1111-setup.sh -f all

[XorPhyson]

Thank you for your support Viking!

git log gives a long list of changes.

% git status               
HEAD detached from cf2772fa
Changes not staged for commit:
  (use "git add <file>..." to update what will be committed)
  (use "git restore <file>..." to discard changes in working directory)
	modified:   modules/sd_disable_initialization.py
	modified:   requirements_versions.txt
	modified:   webui-user.sh

Untracked files:
  (use "git add <file>..." to include in what will be committed)
	.DS_Store
	venv-torch-nightly/
	webui.bundle
	webui.cert
	webui.key

no changes added to commit (use "git add" and/or "git commit -a")

[viking1304]

It looks like you were one of those who reverted A1111 to v1.7.0 by force.

This should fix the detached state and give you the latest version of A1111:

git fetch --all
git reset --hard origin/master

git pull should work as expected after that.

I will update my script to handle detached head cases soon.

Do not use torch 2.2.0 or newer (including nighly) if you are on macOS 14.4. Euler A and similar samplers do not work properly in that environment. Everything works as expected with 2.1.2.

[Kumear]

Hi @viking1304,

First off, thanks for your step-by-step guide on getting A1111 up and running on my MACOS. I've found it really useful, but I'm getting an error with Steps 5 and 6 of the common steps. I've followed all the Steps before that for the new install.

For Step 5, I'm encountering this error:
sed: modules/sd_disable_initialization.py: No such file or directory

And for Step 6, I'm running into this issue:
zsh: no such file or directory: ./webui.sh

I must admit, I've never really used the terminal – probably like five times in my entire life. So, any guidance on what I might be doing wrong would be greatly appreciated.

[viking1304]

You need to be inside the stable-diffusion-webui folder for that to work. You probably closed the terminal after you did some of the previous steps, so the terminal sent you to your home folder when you re-opened it.

To get to the proper folder, you need a command from the start:

cd stable-diffusion-webui

But... if you do not feel "at home" with the terminal, you can use my script, which will do everything for you.

Just run this and wait a little:

sh a1111-setup.sh -f all

[Kumear]

Thank you very much for the quick reply! It has worked this time and I was able to run it!

[viking1304]

I was unable to get images generated with

export COMMANDLINE_ARGS="--skip-torch-cuda-test --opt-sub-quad-attention --upcast-sampling --no-half-vae --medvram-sdxl" Changing it to

export COMMANDLINE_ARGS="--skip-torch-cuda-test --opt-sub-quad-attention --upcast-sampling --no-half --medvram-sdxl"

(--no-half instead of --no-half-vae)

got it working!

This is the exact reason why I do not change command line args by default anymore. Git reset hard should restore the original file from A1111, where params are not set at all, and then it will change the command line only if you use the -f all switch.

Since I have a feeling that your installation is still a bit messy, please do this:

1. go to your home folder and rename stable-diffusion-webui to stable-diffusion-webui-bkp*
2. run my script (without any params), and it will install a fresh version of A1111 in stable-diffusion-webui
3. check if you are getting the same version as in the screenshot i posted
4. close the webui and copy/paste your models from stable-diffusion-webui-bkp to this new install
5. do not edit webui-user.sh
6. run webui agan and try to generate some images

• you can restore the old version at any point by renaming the folder if you copy and not move models in step 4

[raffetazarius]

Since I have a feeling that your installation is still a bit messy, please do this:

1. go to your home folder and rename stable-diffusion-webui to stable-diffusion-webui-bkp*
2. run my script (without any params), and it will install a fresh version of A1111 in stable-diffusion-webui
3. check if you are getting the same version as in the screenshot i posted
4. close the webui and copy/paste your models from stable-diffusion-webui-bkp to this new install
5. do not edit webui-user.sh
6. run webui agan and try to generate some images

• you can restore the old version at any point by renaming the folder if you copy and not move models in step 4

So after uninstalling my dev version of PyTorch, and following the instructions above to create a fresh install of A1111, I now have it running on PyTorch 2.1.2 :)

I'm getting brown/grey boxes generated on the first run of a fresh install of A1111 though, somewhat as expected, since we already determined last week that the default arguments don't work for my setup (perhaps due to me being on Apple Intel.... what we first discussed on Discord anyway), so I updated them.

For this initial run of SD UI, Terminal said:

Launching Web UI with arguments: --skip-torch-cuda-test --upcast-sampling --no-half-vae --use-cpu interrogate

so I edited my webui-user.sh file and updated line 13 to:

export COMMANDLINE_ARGS="--skip-torch-cuda-test --opt-sub-quad-attention --upcast-sampling --no-half --medvram-sdxl --use-cpu interrogate"

i.e. changing --no-half-vae to --no-half

---

After doing this, now no models will load in the UI for me! :(

[viking1304]

Regarding step 2, does it matter where your script is on my hard drive when I run it? I thought it had to be in the stable-diffusion-webui folder, but in this case it won't exist yet...

You can run it from anywhere except /Users/<username>/stable-diffusion-webui. I will probably add a check for that in the next version.

.... you do specify above in #2 (comment) that under "Common steps" that the webui-user.sh file should be modified. However, I think everything from "New install" and below in that post should perhaps go under a new heading "If you don't wish to use my a1111-setup.sh script and install A1111 manually", right?

I thought this sentence was clear enough: Of course, you can still use this step-by-step guide if you want full control. Anything below that line is part of a step-by-step guide.

So after uninstalling my dev version of PyTorch, and following the instructions above to create a fresh install of A1111, I now have it running on PyTorch 2.1.2 :)

You had PyTorch installed as a global package, which usually is not a problem, but since it was newer than the one I specified, the development version was used. Now you can choose which version you want to use inside venv that A1111 uses.

Launching Web UI with arguments: --skip-torch-cuda-test --upcast-sampling --no-half-vae --use-cpu interrogate

Those are the default command line parameters for Mac that the A1111 team added, which, in theory, should work for any standard Mac. They will be used unless you specify something different in webui-user.sh

export COMMANDLINE_ARGS="--skip-torch-cuda-test --opt-sub-quad-attention --upcast-sampling --no-half --medvram-sdxl --use-cpu interrogate"

I noticed that, in some cases, models couldn't load and produce errors when I switch from SDXL to 1.5 or vice versa if I do not switch VAE back to Automatic first. In this case, I recommend switching VAE back to Automatic and restarting webui before trying to change the model.

[viking1304]

export COMMANDLINE_ARGS="--skip-torch-cuda-test --opt-sub-quad-attention --upcast-sampling --no-half --medvram-sdxl --use-cpu interrogate"
After doing this, now no models will load in the UI for me! :(

The same thing just happened to me on iMac with 580x. I solved the problem by adding -disable-model-loading-ram-optimization

Try those command lines, please:
export COMMANDLINE_ARGS="--skip-torch-cuda-test --opt-sub-quad-attention --upcast-sampling --medvram --no-half-vae --use-cpu interrogate --disable-model-loading-ram-optimization"

export COMMANDLINE_ARGS="--skip-torch-cuda-test --opt-sub-quad-attention --upcast-sampling --medvram --no-half --use-cpu interrogate --disable-model-loading-ram-optimization"

export COMMANDLINE_ARGS="--skip-torch-cuda-test --opt-sub-quad-attention --upcast-sampling --no-half --use-cpu interrogate --disable-model-loading-ram-optimization"

export COMMANDLINE_ARGS="--skip-torch-cuda-test --opt-sub-quad-attention --opt-split-attention-v1 --upcast-sampling --medvram --no-half"

[raffetazarius]

Thanks for the tip here. Unfortunately adding -disable-model-loading-ram-optimization didn't get my models going.

There seems to be an issue with the model loading component of the Web UI now..... no model is being loaded on startup of the Web UI, and I cannot switch the model in the UI any longer.

################################################################
Install script for stable-diffusion + Web UI
Tested on Debian 11 (Bullseye), Fedora 34+ and openSUSE Leap 15.4 or newer.
################################################################

################################################################
Running on username user
################################################################

################################################################
Repo already cloned, using it as install directory
################################################################

################################################################
Create and activate python venv
################################################################

################################################################
Launching launch.py...
################################################################
Python 3.10.13 (main, Nov  1 2023, 17:29:04) [Clang 14.0.3 (clang-1403.0.22.14.1)]
Version: v1.7.0
Commit hash: cf2772fab0af5573da775e7437e6acdca424f26e
Launching Web UI with arguments: --skip-torch-cuda-test --opt-sub-quad-attention --upcast-sampling --no-half --medvram --use-cpu interrogate --disable-model-loading-ram-optimization
no module 'xformers'. Processing without...
no module 'xformers'. Processing without...
No module 'xformers'. Proceeding without it.
Style database not found: /Users/username/stable-diffusion-webui/styles.csv
Warning: caught exception 'Torch not compiled with CUDA enabled', memory monitor disabled
[-] ADetailer initialized. version: 23.11.1, num models: 9
Using sqlite file: /Users/username/stable-diffusion-webui/extensions/sd-webui-agent-scheduler/task_scheduler.sqlite3
Checkpoint v1-5-pruned-emaonly.safetensors [6ce0161689] not found; loading fallback SD 1.5/OTHER_MODEL.ckpt
Loading weights [770c826080] from /Users/username/stable-diffusion-webui/models/Stable-diffusion/SD 1.5/OTHER_MODEL.ckpt
Running on local URL:  http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.
Creating model from config: /Users/username/stable-diffusion-webui/configs/v1-inference.yaml
Startup time: 9.9s (prepare environment: 0.4s, import torch: 3.0s, import gradio: 1.0s, setup paths: 0.8s, initialize shared: 0.2s, other imports: 0.9s, load scripts: 1.7s, create ui: 0.9s, gradio launch: 0.4s, app_started_callback: 0.4s).
Applying attention optimization: sub-quadratic... done.
Model loaded in 6.7s (load weights from disk: 1.6s, create model: 1.4s, apply weights to model: 2.5s, calculate empty prompt: 1.1s).

I don't understand why it cannot find v1-5-pruned-emaonly.safetensors - it is in the /models/Stable-diffusion/ folder inside a subfolder "SD 1.5". By "in", I mean there is a symlink (names match exactly) to where it is on another drive.

I don't think it's the subfolder that's the problem, since this issue was occurring even before I put my models in subfolders, plus it's mentioned it works here.

Suspecting it was symlink issue, I deleted the symlink and copied the actual "v1-5-pruned-emaonly.safetensors" model from my other drive to the /models/Stable-diffusion/ folder.

After that, I still get the "cannot find model" error:

Launching Web UI with arguments: --skip-torch-cuda-test --opt-sub-quad-attention --upcast-sampling --no-half --medvram --use-cpu interrogate --disable-model-loading-ram-optimization
no module 'xformers'. Processing without...
no module 'xformers'. Processing without...
No module 'xformers'. Proceeding without it.
Style database not found: /Users/username/stable-diffusion-webui/styles.csv
Warning: caught exception 'Torch not compiled with CUDA enabled', memory monitor disabled
[-] ADetailer initialized. version: 23.11.1, num models: 9
Using sqlite file: /Users/username/stable-diffusion-webui/extensions/sd-webui-agent-scheduler/task_scheduler.sqlite3
Checkpoint v1-5-pruned-emaonly.safetensors [6ce0161689] not found; loading fallback SD 1.5/OTHER_MODEL.ckpt
Loading weights [770c826080] from /Users/username/stable-diffusion-webui/models/Stable-diffusion/SD 1.5/OTHER_MODEL.ckpt
Running on local URL:  http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.
Creating model from config: /Users/username/stable-diffusion-webui/configs/v1-inference.yaml
Startup time: 10.3s (prepare environment: 0.4s, import torch: 3.0s, import gradio: 0.9s, setup paths: 0.9s, initialize shared: 0.2s, other imports: 0.9s, load scripts: 1.9s, create ui: 0.9s, gradio launch: 0.4s, app_started_callback: 0.6s).
Applying attention optimization: sub-quadratic... done.
Model loaded in 6.8s (load weights from disk: 1.7s, create model: 1.5s, apply weights to model: 2.5s, calculate empty prompt: 1.1s).

.... but when I try to generate an image, nothing happens. And when I try to switch model, nothing happens. :(

Is there a way for "flush" previously loaded models and have A1111 rescan all models again like new?

I don't particularly wanna run the a1111-setup.sh script again since it took me a while to set up all my symlinks! :)

[raffetazarius]

No worries - I did a complete reinstall of A1111 and am back up and running!

[raffetazarius]

I downloaded the 0.0.2 a1111-setup script today and tried to run it, but it was unsuccessful:

username@Mac-Pro ~ % cd stable-diffusion-webui
username@Mac-Pro stable-diffusion-webui % sh a1111-setup.sh
Please enter password for user 'username': 
Checking for Homebrew...

Detecting processor...
Intel processor detected

Checking for required packages...
Installing cmake...
cmake is already installed
Installing protobuf...
protobuf is already installed
Installing rust...
rust is already installed
Installing python@3.10...
Running `brew update --auto-update`...
Installing from the API is now the default behaviour!
You can save space and time by running:
  brew untap homebrew/core
==> Auto-updated Homebrew!
Updated 2 taps (homebrew/core and homebrew/cask).
==> New Formulae
opensca-cli                                            purr
==> New Casks
reader

==> Downloading https://ghcr.io/v2/homebrew/core/python/3.10/manifests/3.10.13_1
Already downloaded: /Users/username/Library/Caches/Homebrew/downloads/a610d721ced33d58a439f710e86510660530bd18118bfcc145eb76722ab06a79--python@3.10-3.10.13_1.bottle_manifest.json
==> Fetching python@3.10
==> Downloading https://ghcr.io/v2/homebrew/core/python/3.10/blobs/sha256:f1aa883cec30ef7c9451ae5c4e9654d710
Already downloaded: /Users/username/Library/Caches/Homebrew/downloads/a74ffae21ca2b51f6ad2d1422317d62d8ac973ce971a47e858ef285dfd1b5a84--python@3.10--3.10.13_1.ventura.bottle.tar.gz
==> Pouring python@3.10--3.10.13_1.ventura.bottle.tar.gz
==> /usr/local/Cellar/python@3.10/3.10.13_1/bin/python3.10 -Im ensurepip
==> /usr/local/Cellar/python@3.10/3.10.13_1/bin/python3.10 -Im pip install -v --no-index --upgrade --isolate
==> Caveats
Python has been installed as
  /usr/local/bin/python3.10

Unversioned and major-versioned symlinks `python`, `python3`, `python-config`, `python3-config`, `pip`, `pip3`, etc. pointing to
`python3.10`, `python3.10-config`, `pip3.10` etc., respectively, have been installed into
  /usr/local/opt/python@3.10/libexec/bin

You can install Python packages with
  pip3.10 install <package>
They will install into the site-package directory
  /usr/local/lib/python3.10/site-packages

tkinter is no longer included with this formula, but it is available separately:
  brew install python-tk@3.10

If you do not need a specific version of Python, and always want Homebrew's `python3` in your PATH:
  brew install python3

See: https://docs.brew.sh/Homebrew-and-Python
==> Summary
🍺  /usr/local/Cellar/python@3.10/3.10.13_1: 3,096 files, 55.9MB
==> Running `brew cleanup python@3.10`...
Disable this behaviour by setting HOMEBREW_NO_INSTALL_CLEANUP.
Hide these hints with HOMEBREW_NO_ENV_HINTS (see `man brew`).
python@3.10 is installed
Installing git...
git is already installed
Installing wget...
wget is already installed

Existing installation detected...
Forcing A1111 upgrade...
HEAD is now at 4afaaf8a add changelog entry
remote: Enumerating objects: 421, done.
remote: Counting objects: 100% (391/391), done.
remote: Compressing objects: 100% (156/156), done.
remote: Total 421 (delta 286), reused 312 (delta 231), pack-reused 30
Receiving objects: 100% (421/421), 196.10 KiB | 1.71 MiB/s, done.
Resolving deltas: 100% (289/289), completed with 30 local objects.
From https://github.com/AUTOMATIC1111/stable-diffusion-webui
   4afaaf8a..cf2772fa  master            -> origin/master
   f92d6149..de03882d  dev               -> origin/dev
   cc41cc43..0c542796  on-mouse-hover-show-hide-modal-image-viewer-icons -> origin/on-mouse-hover-show-hide-modal-image-viewer-icons
   120a84bd..cf2772fa  release_candidate -> origin/release_candidate
 * [new tag]           v1.7.0            -> v1.7.0
Updating 4afaaf8a..cf2772fa
Fast-forward
 .eslintrc.js                                                              |   1 +
 .github/ISSUE_TEMPLATE/bug_report.yml                                     |  67 +++++--
 .github/workflows/on_pull_request.yaml                                    |   2 +-
 CHANGELOG.md                                                              | 162 +++++++++++++++
 README.md                                                                 |  12 +-
 configs/alt-diffusion-m18-inference.yaml                                  |  73 +++++++
 extensions-builtin/Lora/lora_logger.py                                    |  33 +++
 extensions-builtin/Lora/lyco_helpers.py                                   |  47 +++++
 extensions-builtin/Lora/network.py                                        |   1 +
 extensions-builtin/Lora/network_glora.py                                  |  33 +++
 extensions-builtin/Lora/network_oft.py                                    |  82 ++++++++
 extensions-builtin/Lora/networks.py                                       |  60 +++++-
 extensions-builtin/Lora/ui_extra_networks_lora.py                         |   7 +-
 extensions-builtin/extra-options-section/scripts/extra_options_section.py |  16 +-
 extensions-builtin/hypertile/hypertile.py                                 | 351 ++++++++++++++++++++++++++++++++
 extensions-builtin/hypertile/scripts/hypertile_script.py                  | 109 ++++++++++
 extensions-builtin/hypertile/scripts/hypertile_xyz.py                     |  51 +++++
 extensions-builtin/mobile/javascript/mobile.js                            |   2 +
 javascript/dragdrop.js                                                    |   2 +-
 javascript/edit-attention.js                                              |  79 +++++---
 javascript/extraNetworks.js                                               |  95 +++++++--
 javascript/imageviewer.js                                                 |   7 +-
 javascript/inputAccordion.js                                              |  81 +++++---
 javascript/notification.js                                                |   6 +-
 javascript/settings.js                                                    |  71 +++++++
 javascript/token-counters.js                                              |  26 +--
 javascript/ui.js                                                          |  73 +++++--
 modules/api/api.py                                                        |  81 ++++----
 modules/api/models.py                                                     |  39 ++--
 modules/cache.py                                                          |   2 +-
 modules/cmd_args.py                                                       |  10 +-
 modules/config_states.py                                                  |   3 +-
 modules/devices.py                                                        |  18 +-
 modules/errors.py                                                         |  18 +-
 modules/extensions.py                                                     |  96 +++++++--
 modules/generation_parameters_copypaste.py                                |  15 +-
 modules/gfpgan_model.py                                                   |  25 ++-
 modules/gitpython_hack.py                                                 |   2 +-
 modules/gradio_extensons.py                                               |  10 +
 modules/hypernetworks/hypernetwork.py                                     |   4 +-
 modules/images.py                                                         |  19 +-
 modules/img2img.py                                                        |  56 ++++--
 modules/import_hook.py                                                    |  11 +
 modules/initialize.py                                                     |   4 +-
 modules/initialize_util.py                                                |   6 +-
 modules/launch_utils.py                                                   |  42 +++-
 modules/localization.py                                                   |  21 +-
 modules/logging_config.py                                                 |  27 ++-
 modules/mac_specific.py                                                   |  15 ++
 modules/models/diffusion/ddpm_edit.py                                     |   7 +-
 modules/options.py                                                        |  81 +++++++-
 modules/paths.py                                                          |   2 +-
 modules/paths_internal.py                                                 |   1 +
 modules/postprocessing.py                                                 |  94 +++++++--
 modules/processing.py                                                     |  53 +++--
 modules/processing_scripts/seed.py                                        |   4 +-
 modules/prompt_parser.py                                                  |   9 +-
 modules/restart.py                                                        |   4 +-
 modules/rng.py                                                            |   2 +-
 modules/script_callbacks.py                                               |   6 +-
 modules/scripts.py                                                        | 137 +++++++++++--
 modules/scripts_postprocessing.py                                         |  86 +++++++-
 modules/sd_disable_initialization.py                                      |   2 +-
 modules/sd_hijack.py                                                      |  41 +++-
 modules/sd_models.py                                                      |  70 ++++---
 modules/sd_models_config.py                                               |   5 +-
 modules/sd_models_types.py                                                |   5 +-
 modules/sd_samplers_extra.py                                              |   2 +-
 modules/sd_samplers_timesteps_impl.py                                     |   4 +-
 modules/sd_unet.py                                                        |  14 +-
 modules/shared_cmd_options.py                                             |   4 +-
 modules/shared_items.py                                                   |  22 +-
 modules/shared_options.py                                                 | 145 +++++++++-----
 modules/shared_state.py                                                   |   2 +-
 modules/styles.py                                                         | 169 +++++++++++++---
 modules/sub_quadratic_attention.py                                        |   4 +-
 modules/sysinfo.py                                                        |  18 +-
 modules/textual_inversion/autocrop.py                                     | 239 +++++++++++-----------
 modules/textual_inversion/preprocess.py                                   | 232 ---------------------
 modules/textual_inversion/textual_inversion.py                            |  78 ++++----
 modules/textual_inversion/ui.py                                           |   7 -
 modules/txt2img.py                                                        |   4 +-
 modules/ui.py                                                             | 420 ++++++++++++---------------------------
 modules/ui_common.py                                                      |  15 +-
 modules/ui_extensions.py                                                  |  19 +-
 modules/ui_extra_networks.py                                              |  65 ++++--
 modules/ui_extra_networks_checkpoints.py                                  |  10 +-
 modules/ui_extra_networks_hypernets.py                                    |  13 +-
 modules/ui_extra_networks_textual_inversion.py                            |  10 +-
 modules/ui_extra_networks_user_metadata.py                                |   2 +-
 modules/ui_gradio_extensions.py                                           |   6 +-
 modules/ui_loadsave.py                                                    |  24 ++-
 modules/ui_postprocessing.py                                              |  18 +-
 modules/ui_prompt_styles.py                                               |  32 ++-
 modules/ui_settings.py                                                    |  59 +++++-
 modules/ui_toprow.py                                                      | 143 +++++++++++++
 modules/upscaler.py                                                       |   6 +-
 modules/xlmr_m18.py                                                       | 164 +++++++++++++++
 modules/xpu_specific.py                                                   |  59 ++++++
 pyproject.toml                                                            |   1 +
 requirements_versions.txt                                                 |   2 +-
 script.js                                                                 |  33 ++-
 scripts/postprocessing_caption.py                                         |  30 +++
 scripts/postprocessing_codeformer.py                                      |  16 +-
 scripts/postprocessing_create_flipped_copies.py                           |  32 +++
 scripts/postprocessing_focal_crop.py                                      |  54 +++++
 scripts/postprocessing_gfpgan.py                                          |  13 +-
 scripts/postprocessing_split_oversized.py                                 |  71 +++++++
 scripts/postprocessing_upscale.py                                         |  14 +-
 scripts/processing_autosized_crop.py                                      |  64 ++++++
 scripts/prompts_from_file.py                                              |  32 ++-
 scripts/xyz_grid.py                                                       |   7 +-
 style.css                                                                 |  69 ++++++-
 webui.bat                                                                 |   5 +
 webui.py                                                                  |   2 +-
 webui.sh                                                                  |  23 ++-
 116 files changed, 3830 insertions(+), 1329 deletions(-)
 create mode 100644 configs/alt-diffusion-m18-inference.yaml
 create mode 100644 extensions-builtin/Lora/lora_logger.py
 create mode 100644 extensions-builtin/Lora/network_glora.py
 create mode 100644 extensions-builtin/Lora/network_oft.py
 create mode 100644 extensions-builtin/hypertile/hypertile.py
 create mode 100644 extensions-builtin/hypertile/scripts/hypertile_script.py
 create mode 100644 extensions-builtin/hypertile/scripts/hypertile_xyz.py
 create mode 100644 javascript/settings.js
 delete mode 100644 modules/textual_inversion/preprocess.py
 create mode 100644 modules/ui_toprow.py
 create mode 100644 modules/xlmr_m18.py
 create mode 100644 modules/xpu_specific.py
 create mode 100644 scripts/postprocessing_caption.py
 create mode 100644 scripts/postprocessing_create_flipped_copies.py
 create mode 100644 scripts/postprocessing_focal_crop.py
 create mode 100644 scripts/postprocessing_split_oversized.py
 create mode 100644 scripts/processing_autosized_crop.py
Purging pip cache...
Files removed: 916
Removing venv...
rm: venv/lib/python3.10/site-packages: Permission denied
rm: venv/lib/python3.10: Permission denied
rm: venv/lib: Permission denied
rm: venv: Permission denied

Instruct A1111 to use latest stable version of torch...
Fix cannot convert a MPS Tensor to float64 dtype error...

################################################################
Install script for stable-diffusion + Web UI
Tested on Debian 11 (Bullseye), Fedora 34+ and openSUSE Leap 15.4 or newer.
################################################################

################################################################
Running on username user
################################################################

################################################################
Repo already cloned, using it as install directory
################################################################

################################################################
Create and activate python venv
################################################################

################################################################
ERROR: Cannot activate python venv, aborting...
################################################################

username@Mac-Pro stable-diffusion-webui % 

So i tried following the "existing install" instructions above instead.

@viking1304 - I wonder if it would be a good idea for a1111-setup.sh to include those commands if an existing install was detected?

After doing these, the Web UI loaded up successfully :)

username@Mac-Pro stable-diffusion-webui % git reset --hard origin/master
HEAD is now at cf2772fa Merge branch 'release_candidate'

username@Mac-Pro stable-diffusion-webui % git pull
Already up to date.

username@Mac-Pro stable-diffusion-webui % venv/bin/pip cache purge
zsh: no such file or directory: venv/bin/pip

username@Mac-Pro stable-diffusion-webui % rm -rf venv

username@Mac-Pro stable-diffusion-webui % sed -i '' "/^                    dtype = sd_param.dtype if sd_param is not None else param.dtype/,/^ *[^:]*:/s/module._parameters\[name\] = torch.nn.parameter.Parameter/if dtype == torch.float64 and device.type == 'mps':\n                      dtype = torch.float32\n                    module._parameters\[name\] = torch.nn.parameter.Parameter/" modules/sd_disable_initialization.py

username@Mac-Pro stable-diffusion-webui % ./webui.sh

################################################################
Install script for stable-diffusion + Web UI
Tested on Debian 11 (Bullseye), Fedora 34+ and openSUSE Leap 15.4 or newer.
################################################################

################################################################
Running on username user
################################################################

################################################################
Repo already cloned, using it as install directory
################################################################

################################################################
Create and activate python venv
################################################################

################################################################
Launching launch.py...
################################################################
Python 3.10.13 (main, Nov  1 2023, 17:29:04) [Clang 14.0.3 (clang-1403.0.22.14.1)]
Version: v1.7.0
Commit hash: cf2772fab0af5573da775e7437e6acdca424f26e
Installing torch and torchvision
Collecting torch
  Downloading torch-2.1.2-cp310-none-macosx_10_9_x86_64.whl.metadata (25 kB)
Collecting torchvision
  Downloading torchvision-0.16.2-cp310-cp310-macosx_10_13_x86_64.whl.metadata (6.6 kB)
Collecting torchaudio
  Downloading torchaudio-2.1.2-cp310-cp310-macosx_10_13_x86_64.whl.metadata (6.4 kB)
Collecting filelock (from torch)
  Downloading filelock-3.13.1-py3-none-any.whl.metadata (2.8 kB)
Collecting typing-extensions (from torch)
  Downloading typing_extensions-4.9.0-py3-none-any.whl.metadata (3.0 kB)
Collecting sympy (from torch)
  Downloading sympy-1.12-py3-none-any.whl (5.7 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 5.7/5.7 MB 26.0 MB/s eta 0:00:00
Collecting networkx (from torch)
  Downloading networkx-3.2.1-py3-none-any.whl.metadata (5.2 kB)
Collecting jinja2 (from torch)
  Downloading Jinja2-3.1.2-py3-none-any.whl (133 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 133.1/133.1 kB 5.2 MB/s eta 0:00:00
Collecting fsspec (from torch)
  Downloading fsspec-2023.12.2-py3-none-any.whl.metadata (6.8 kB)
Collecting numpy (from torchvision)
  Downloading numpy-1.26.2-cp310-cp310-macosx_10_9_x86_64.whl.metadata (61 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61.2/61.2 kB 2.3 MB/s eta 0:00:00
Collecting requests (from torchvision)
  Downloading requests-2.31.0-py3-none-any.whl.metadata (4.6 kB)
Collecting pillow!=8.3.*,>=5.3.0 (from torchvision)
  Downloading Pillow-10.1.0-cp310-cp310-macosx_10_10_x86_64.whl.metadata (9.5 kB)
Collecting MarkupSafe>=2.0 (from jinja2->torch)
  Downloading MarkupSafe-2.1.3-cp310-cp310-macosx_10_9_x86_64.whl.metadata (3.0 kB)
Collecting charset-normalizer<4,>=2 (from requests->torchvision)
  Downloading charset_normalizer-3.3.2-cp310-cp310-macosx_10_9_x86_64.whl.metadata (33 kB)
Collecting idna<4,>=2.5 (from requests->torchvision)
  Downloading idna-3.6-py3-none-any.whl.metadata (9.9 kB)
Collecting urllib3<3,>=1.21.1 (from requests->torchvision)
  Downloading urllib3-2.1.0-py3-none-any.whl.metadata (6.4 kB)
Collecting certifi>=2017.4.17 (from requests->torchvision)
  Downloading certifi-2023.11.17-py3-none-any.whl.metadata (2.2 kB)
Collecting mpmath>=0.19 (from sympy->torch)
  Downloading mpmath-1.3.0-py3-none-any.whl (536 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 536.2/536.2 kB 15.1 MB/s eta 0:00:00
Downloading torch-2.1.2-cp310-none-macosx_10_9_x86_64.whl (147.0 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 147.0/147.0 MB 19.5 MB/s eta 0:00:00
Downloading torchvision-0.16.2-cp310-cp310-macosx_10_13_x86_64.whl (1.6 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.6/1.6 MB 24.3 MB/s eta 0:00:00
Downloading torchaudio-2.1.2-cp310-cp310-macosx_10_13_x86_64.whl (3.3 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.3/3.3 MB 15.6 MB/s eta 0:00:00
Downloading Pillow-10.1.0-cp310-cp310-macosx_10_10_x86_64.whl (3.5 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.5/3.5 MB 33.4 MB/s eta 0:00:00
Downloading filelock-3.13.1-py3-none-any.whl (11 kB)
Downloading fsspec-2023.12.2-py3-none-any.whl (168 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 169.0/169.0 kB 6.5 MB/s eta 0:00:00
Downloading networkx-3.2.1-py3-none-any.whl (1.6 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.6/1.6 MB 27.8 MB/s eta 0:00:00
Downloading numpy-1.26.2-cp310-cp310-macosx_10_9_x86_64.whl (20.6 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 20.6/20.6 MB 38.0 MB/s eta 0:00:00
Downloading requests-2.31.0-py3-none-any.whl (62 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62.6/62.6 kB 2.4 MB/s eta 0:00:00
Downloading typing_extensions-4.9.0-py3-none-any.whl (32 kB)
Downloading certifi-2023.11.17-py3-none-any.whl (162 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 162.5/162.5 kB 6.6 MB/s eta 0:00:00
Downloading charset_normalizer-3.3.2-cp310-cp310-macosx_10_9_x86_64.whl (122 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 122.5/122.5 kB 4.8 MB/s eta 0:00:00
Downloading idna-3.6-py3-none-any.whl (61 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61.6/61.6 kB 2.5 MB/s eta 0:00:00
Downloading MarkupSafe-2.1.3-cp310-cp310-macosx_10_9_x86_64.whl (13 kB)
Downloading urllib3-2.1.0-py3-none-any.whl (104 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 104.6/104.6 kB 4.0 MB/s eta 0:00:00
Installing collected packages: mpmath, urllib3, typing-extensions, sympy, pillow, numpy, networkx, MarkupSafe, idna, fsspec, filelock, charset-normalizer, certifi, requests, jinja2, torch, torchvision, torchaudio
Successfully installed MarkupSafe-2.1.3 certifi-2023.11.17 charset-normalizer-3.3.2 filelock-3.13.1 fsspec-2023.12.2 idna-3.6 jinja2-3.1.2 mpmath-1.3.0 networkx-3.2.1 numpy-1.26.2 pillow-10.1.0 requests-2.31.0 sympy-1.12 torch-2.1.2 torchaudio-2.1.2 torchvision-0.16.2 typing-extensions-4.9.0 urllib3-2.1.0
Installing clip
Installing open_clip
Installing requirements for CodeFormer
Installing requirements
Collecting ultralytics>=8.0.209
  Downloading ultralytics-8.0.227-py3-none-any.whl.metadata (32 kB)
Requirement already satisfied: matplotlib>=3.3.0 in ./venv/lib/python3.10/site-packages (from ultralytics>=8.0.209) (3.8.2)
Requirement already satisfied: numpy>=1.22.2 in ./venv/lib/python3.10/site-packages (from ultralytics>=8.0.209) (1.23.5)
Requirement already satisfied: opencv-python>=4.6.0 in ./venv/lib/python3.10/site-packages (from ultralytics>=8.0.209) (4.8.1.78)
Requirement already satisfied: pillow>=7.1.2 in ./venv/lib/python3.10/site-packages (from ultralytics>=8.0.209) (9.5.0)
Requirement already satisfied: pyyaml>=5.3.1 in ./venv/lib/python3.10/site-packages (from ultralytics>=8.0.209) (6.0.1)
Requirement already satisfied: requests>=2.23.0 in ./venv/lib/python3.10/site-packages (from ultralytics>=8.0.209) (2.31.0)
Requirement already satisfied: scipy>=1.4.1 in ./venv/lib/python3.10/site-packages (from ultralytics>=8.0.209) (1.11.4)
Requirement already satisfied: torch>=1.8.0 in ./venv/lib/python3.10/site-packages (from ultralytics>=8.0.209) (2.1.2)
Requirement already satisfied: torchvision>=0.9.0 in ./venv/lib/python3.10/site-packages (from ultralytics>=8.0.209) (0.16.2)
Requirement already satisfied: tqdm>=4.64.0 in ./venv/lib/python3.10/site-packages (from ultralytics>=8.0.209) (4.66.1)
Requirement already satisfied: pandas>=1.1.4 in ./venv/lib/python3.10/site-packages (from ultralytics>=8.0.209) (2.1.4)
Collecting seaborn>=0.11.0 (from ultralytics>=8.0.209)
  Downloading seaborn-0.13.0-py3-none-any.whl.metadata (5.3 kB)
Requirement already satisfied: psutil in ./venv/lib/python3.10/site-packages (from ultralytics>=8.0.209) (5.9.5)
Collecting py-cpuinfo (from ultralytics>=8.0.209)
  Downloading py_cpuinfo-9.0.0-py3-none-any.whl (22 kB)
Collecting thop>=0.1.1 (from ultralytics>=8.0.209)
  Downloading thop-0.1.1.post2209072238-py3-none-any.whl (15 kB)
Requirement already satisfied: contourpy>=1.0.1 in ./venv/lib/python3.10/site-packages (from matplotlib>=3.3.0->ultralytics>=8.0.209) (1.2.0)
Requirement already satisfied: cycler>=0.10 in ./venv/lib/python3.10/site-packages (from matplotlib>=3.3.0->ultralytics>=8.0.209) (0.12.1)
Requirement already satisfied: fonttools>=4.22.0 in ./venv/lib/python3.10/site-packages (from matplotlib>=3.3.0->ultralytics>=8.0.209) (4.46.0)
Requirement already satisfied: kiwisolver>=1.3.1 in ./venv/lib/python3.10/site-packages (from matplotlib>=3.3.0->ultralytics>=8.0.209) (1.4.5)
Requirement already satisfied: packaging>=20.0 in ./venv/lib/python3.10/site-packages (from matplotlib>=3.3.0->ultralytics>=8.0.209) (23.2)
Requirement already satisfied: pyparsing>=2.3.1 in ./venv/lib/python3.10/site-packages (from matplotlib>=3.3.0->ultralytics>=8.0.209) (3.1.1)
Requirement already satisfied: python-dateutil>=2.7 in ./venv/lib/python3.10/site-packages (from matplotlib>=3.3.0->ultralytics>=8.0.209) (2.8.2)
Requirement already satisfied: pytz>=2020.1 in ./venv/lib/python3.10/site-packages (from pandas>=1.1.4->ultralytics>=8.0.209) (2023.3.post1)
Requirement already satisfied: tzdata>=2022.1 in ./venv/lib/python3.10/site-packages (from pandas>=1.1.4->ultralytics>=8.0.209) (2023.3)
Requirement already satisfied: charset-normalizer<4,>=2 in ./venv/lib/python3.10/site-packages (from requests>=2.23.0->ultralytics>=8.0.209) (3.3.2)
Requirement already satisfied: idna<4,>=2.5 in ./venv/lib/python3.10/site-packages (from requests>=2.23.0->ultralytics>=8.0.209) (3.6)
Requirement already satisfied: urllib3<3,>=1.21.1 in ./venv/lib/python3.10/site-packages (from requests>=2.23.0->ultralytics>=8.0.209) (2.1.0)
Requirement already satisfied: certifi>=2017.4.17 in ./venv/lib/python3.10/site-packages (from requests>=2.23.0->ultralytics>=8.0.209) (2023.11.17)
Requirement already satisfied: filelock in ./venv/lib/python3.10/site-packages (from torch>=1.8.0->ultralytics>=8.0.209) (3.13.1)
Requirement already satisfied: typing-extensions in ./venv/lib/python3.10/site-packages (from torch>=1.8.0->ultralytics>=8.0.209) (4.9.0)
Requirement already satisfied: sympy in ./venv/lib/python3.10/site-packages (from torch>=1.8.0->ultralytics>=8.0.209) (1.12)
Requirement already satisfied: networkx in ./venv/lib/python3.10/site-packages (from torch>=1.8.0->ultralytics>=8.0.209) (3.2.1)
Requirement already satisfied: jinja2 in ./venv/lib/python3.10/site-packages (from torch>=1.8.0->ultralytics>=8.0.209) (3.1.2)
Requirement already satisfied: fsspec in ./venv/lib/python3.10/site-packages (from torch>=1.8.0->ultralytics>=8.0.209) (2023.12.2)
Requirement already satisfied: six>=1.5 in ./venv/lib/python3.10/site-packages (from python-dateutil>=2.7->matplotlib>=3.3.0->ultralytics>=8.0.209) (1.16.0)
Requirement already satisfied: MarkupSafe>=2.0 in ./venv/lib/python3.10/site-packages (from jinja2->torch>=1.8.0->ultralytics>=8.0.209) (2.1.3)
Requirement already satisfied: mpmath>=0.19 in ./venv/lib/python3.10/site-packages (from sympy->torch>=1.8.0->ultralytics>=8.0.209) (1.3.0)
Downloading ultralytics-8.0.227-py3-none-any.whl (660 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 660.5/660.5 kB 6.2 MB/s eta 0:00:00
Downloading seaborn-0.13.0-py3-none-any.whl (294 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 294.6/294.6 kB 7.5 MB/s eta 0:00:00
Installing collected packages: py-cpuinfo, thop, seaborn, ultralytics
Successfully installed py-cpuinfo-9.0.0 seaborn-0.13.0 thop-0.1.1.post2209072238 ultralytics-8.0.227
Collecting mediapipe>=0.10.8
  Downloading mediapipe-0.10.9-cp310-cp310-macosx_11_0_x86_64.whl.metadata (9.6 kB)
Requirement already satisfied: absl-py in ./venv/lib/python3.10/site-packages (from mediapipe>=0.10.8) (2.0.0)
Requirement already satisfied: attrs>=19.1.0 in ./venv/lib/python3.10/site-packages (from mediapipe>=0.10.8) (23.1.0)
Collecting flatbuffers>=2.0 (from mediapipe>=0.10.8)
  Downloading flatbuffers-23.5.26-py2.py3-none-any.whl.metadata (850 bytes)
Requirement already satisfied: matplotlib in ./venv/lib/python3.10/site-packages (from mediapipe>=0.10.8) (3.8.2)
Requirement already satisfied: numpy in ./venv/lib/python3.10/site-packages (from mediapipe>=0.10.8) (1.23.5)
Collecting opencv-contrib-python (from mediapipe>=0.10.8)
  Downloading opencv_contrib_python-4.8.1.78-cp37-abi3-macosx_10_16_x86_64.whl.metadata (19 kB)
Requirement already satisfied: protobuf<4,>=3.11 in ./venv/lib/python3.10/site-packages (from mediapipe>=0.10.8) (3.20.0)
Collecting sounddevice>=0.4.4 (from mediapipe>=0.10.8)
  Downloading sounddevice-0.4.6-py3-none-macosx_10_6_x86_64.macosx_10_6_universal2.whl (107 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 108.0/108.0 kB 2.2 MB/s eta 0:00:00
Collecting CFFI>=1.0 (from sounddevice>=0.4.4->mediapipe>=0.10.8)
  Downloading cffi-1.16.0-cp310-cp310-macosx_10_9_x86_64.whl.metadata (1.5 kB)
Requirement already satisfied: contourpy>=1.0.1 in ./venv/lib/python3.10/site-packages (from matplotlib->mediapipe>=0.10.8) (1.2.0)
Requirement already satisfied: cycler>=0.10 in ./venv/lib/python3.10/site-packages (from matplotlib->mediapipe>=0.10.8) (0.12.1)
Requirement already satisfied: fonttools>=4.22.0 in ./venv/lib/python3.10/site-packages (from matplotlib->mediapipe>=0.10.8) (4.46.0)
Requirement already satisfied: kiwisolver>=1.3.1 in ./venv/lib/python3.10/site-packages (from matplotlib->mediapipe>=0.10.8) (1.4.5)
Requirement already satisfied: packaging>=20.0 in ./venv/lib/python3.10/site-packages (from matplotlib->mediapipe>=0.10.8) (23.2)
Requirement already satisfied: pillow>=8 in ./venv/lib/python3.10/site-packages (from matplotlib->mediapipe>=0.10.8) (9.5.0)
Requirement already satisfied: pyparsing>=2.3.1 in ./venv/lib/python3.10/site-packages (from matplotlib->mediapipe>=0.10.8) (3.1.1)
Requirement already satisfied: python-dateutil>=2.7 in ./venv/lib/python3.10/site-packages (from matplotlib->mediapipe>=0.10.8) (2.8.2)
Collecting pycparser (from CFFI>=1.0->sounddevice>=0.4.4->mediapipe>=0.10.8)
  Downloading pycparser-2.21-py2.py3-none-any.whl (118 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 118.7/118.7 kB 2.7 MB/s eta 0:00:00
Requirement already satisfied: six>=1.5 in ./venv/lib/python3.10/site-packages (from python-dateutil>=2.7->matplotlib->mediapipe>=0.10.8) (1.16.0)
Downloading mediapipe-0.10.9-cp310-cp310-macosx_11_0_x86_64.whl (47.1 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 47.1/47.1 MB 26.9 MB/s eta 0:00:00
Downloading flatbuffers-23.5.26-py2.py3-none-any.whl (26 kB)
Downloading opencv_contrib_python-4.8.1.78-cp37-abi3-macosx_10_16_x86_64.whl (64.4 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 64.4/64.4 MB 14.1 MB/s eta 0:00:00
Downloading cffi-1.16.0-cp310-cp310-macosx_10_9_x86_64.whl (182 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 182.5/182.5 kB 6.3 MB/s eta 0:00:00
Installing collected packages: flatbuffers, pycparser, opencv-contrib-python, CFFI, sounddevice, mediapipe
Successfully installed CFFI-1.16.0 flatbuffers-23.5.26 mediapipe-0.10.9 opencv-contrib-python-4.8.1.78 pycparser-2.21 sounddevice-0.4.6
Collecting rich>=13.0.0
  Downloading rich-13.7.0-py3-none-any.whl.metadata (18 kB)
Collecting markdown-it-py>=2.2.0 (from rich>=13.0.0)
  Downloading markdown_it_py-3.0.0-py3-none-any.whl.metadata (6.9 kB)
Collecting pygments<3.0.0,>=2.13.0 (from rich>=13.0.0)
  Downloading pygments-2.17.2-py3-none-any.whl.metadata (2.6 kB)
Collecting mdurl~=0.1 (from markdown-it-py>=2.2.0->rich>=13.0.0)
  Downloading mdurl-0.1.2-py3-none-any.whl (10.0 kB)
Downloading rich-13.7.0-py3-none-any.whl (240 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 240.6/240.6 kB 2.9 MB/s eta 0:00:00
Downloading markdown_it_py-3.0.0-py3-none-any.whl (87 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 87.5/87.5 kB 3.0 MB/s eta 0:00:00
Downloading pygments-2.17.2-py3-none-any.whl (1.2 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 14.2 MB/s eta 0:00:00
Installing collected packages: pygments, mdurl, markdown-it-py, rich
Successfully installed markdown-it-py-3.0.0 mdurl-0.1.2 pygments-2.17.2 rich-13.7.0
Installing requirement for task-scheduler
Launching Web UI with arguments: --skip-torch-cuda-test --opt-sub-quad-attention --upcast-sampling --no-half-vae --medvram-sdxl
no module 'xformers'. Processing without...
no module 'xformers'. Processing without...
No module 'xformers'. Proceeding without it.
Style database not found: /Users/username/stable-diffusion-webui/styles.csv
Warning: caught exception 'Torch not compiled with CUDA enabled', memory monitor disabled
[-] ADetailer initialized. version: 23.11.1, num models: 10
Using sqlite file: /Users/username/stable-diffusion-webui/extensions/sd-webui-agent-scheduler/task_scheduler.sqlite3
Loading weights [0724518c6b] from /Users/username/stable-diffusion-webui/models/Stable-diffusion/juggernautXL_v7Rundiffusion.safetensors
Creating model from config: /Users/username/stable-diffusion-webui/repositories/generative-models/configs/inference/sd_xl_base.yaml
Applying attention optimization: sub-quadratic... done.
Model loaded in 15.8s (load weights from disk: 2.0s, create model: 0.4s, apply weights to model: 10.6s, apply half(): 0.1s, calculate empty prompt: 2.6s).
Running on local URL:  http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.
Startup time: 210.9s (prepare environment: 184.8s, import torch: 3.6s, import gradio: 1.0s, setup paths: 1.0s, initialize shared: 0.3s, other imports: 1.2s, load scripts: 2.0s, create ui: 15.9s, gradio launch: 0.4s, app_started_callback: 0.6s).

[viking1304]

My M1 shows almost 100% usage of GPU during generation.

[viking1304]

I just released version 0.0.3, which brings some tweaks and minor improvements.

[raffetazarius]

Weird I wonder why my Radeon has low utilization.

I'm just thinking... I'd like to remove the PyTorch install I have (the developer build) and go with the one you recommend. How can I uninstall PyTorch (installed using pip as instructed here)?

[raffetazarius]

Actually after some Googling I think I figured it out

username@Users-Mac-Pro ~ % pip3 uninstall torch torchvision torchaudio
Found existing installation: torch 2.2.0.dev20231213
Uninstalling torch-2.2.0.dev20231213:
  Would remove:
    /Users/username/.pyenv/versions/3.11.6/bin/convert-caffe2-to-onnx
    /Users/username/.pyenv/versions/3.11.6/bin/convert-onnx-to-caffe2
    /Users/username/.pyenv/versions/3.11.6/bin/torchrun
    /Users/username/.pyenv/versions/3.11.6/lib/python3.11/site-packages/functorch/*
    /Users/username/.pyenv/versions/3.11.6/lib/python3.11/site-packages/torch-2.2.0.dev20231213.dist-info/*
    /Users/username/.pyenv/versions/3.11.6/lib/python3.11/site-packages/torch/*
    /Users/username/.pyenv/versions/3.11.6/lib/python3.11/site-packages/torchgen/*
Proceed (Y/n)? y
  Successfully uninstalled torch-2.2.0.dev20231213
Found existing installation: torchvision 0.18.0.dev20231213
Uninstalling torchvision-0.18.0.dev20231213:
  Would remove:
    /Users/username/.pyenv/versions/3.11.6/lib/python3.11/site-packages/torchvision-0.18.0.dev20231213.dist-info/*
    /Users/username/.pyenv/versions/3.11.6/lib/python3.11/site-packages/torchvision/*
Proceed (Y/n)? y
  Successfully uninstalled torchvision-0.18.0.dev20231213
Found existing installation: torchaudio 2.2.0.dev20231213
Uninstalling torchaudio-2.2.0.dev20231213:
  Would remove:
    /Users/username/.pyenv/versions/3.11.6/lib/python3.11/site-packages/torchaudio-2.2.0.dev20231213.dist-info/*
    /Users/username/.pyenv/versions/3.11.6/lib/python3.11/site-packages/torchaudio/*
    /Users/username/.pyenv/versions/3.11.6/lib/python3.11/site-packages/torio/*
Proceed (Y/n)? y
  Successfully uninstalled torchaudio-2.2.0.dev20231213
username@Users-Mac-Pro ~ % 

[viking1304]

Weird I wonder why my Radeon has low utilization.

580X 8GB in my iMac (with exactly the same params as my M1, which does not work for you)