DEADLY slow generation RTX 3080

[iiiCpu]

Well, if you thought 0:28 was slow against 0:20, check out this!

checkpoint: ponyDiffusionV6XL.safetensors [67ab2fd8ec]
Euler a @ automated
768*896
steps: 20
cfg: 7
+: "1girl"
-: ""

Total progress:  20/20 [02:16<00:00,  6.82s/it]

All extra extensions disabled. With extensions enabled it slows down even further to 5:10 per image.

version: v1.9.4  •  python: 3.10.11  •  torch: 2.3.0+cu121  •  xformers: N/A  •  gradio: 3.41.2  •  checkpoint: [67ab2fd8ec]

pip list

Package                   Version
------------------------- ------------------
absl-py                   2.1.0
accelerate                0.21.0
addict                    2.4.0
aenum                     3.1.15
aiofiles                  23.2.1
aiohttp                   3.9.5
aiosignal                 1.3.1
albucore                  0.0.9
albumentations            1.4.8
aliyun-python-sdk-core    2.15.1
aliyun-python-sdk-kms     2.16.3
altair                    5.3.0
annotated-types           0.7.0
antlr4-python3-runtime    4.9.3
anyio                     3.7.1
async-timeout             4.0.3
attrs                     23.2.0
blendmodes                2022
certifi                   2024.6.2
cffi                      1.16.0
chardet                   5.2.0
charset-normalizer        3.3.2
clean-fid                 0.1.35
click                     8.1.7
clip                      1.0
colorama                  0.4.6
coloredlogs               15.0.1
colorlog                  6.8.2
contourpy                 1.2.1
crcmod                    1.7
cryptography              42.0.8
cssselect2                0.7.0
cycler                    0.12.1
Cython                    3.0.10
decorator                 4.4.2
defusedxml                0.7.1
deprecation               2.1.0
depth_anything            2024.1.22.0
diffusers                 0.28.2
dill                      0.3.8
diskcache                 5.6.3
dlib                      19.24.4
dnspython                 2.6.1
dominate                  2.9.1
dsine                     2024.3.23
easydict                  1.13
einops                    0.4.1
email_validator           2.1.1
embreex                   2.17.7.post4
exceptiongroup            1.2.1
facexlib                  0.3.0
fastapi                   0.94.0
fastapi-cli               0.0.4
ffmpy                     0.3.2
filelock                  3.14.0
filterpy                  1.4.5
flatbuffers               24.3.25
fonttools                 4.53.0
freetype-py               2.4.0
frozenlist                1.4.1
fsspec                    2024.2.0
ftfy                      6.2.0
fvcore                    0.1.5.post20221221
geffnet                   1.0.2
gitdb                     4.0.11
GitPython                 3.1.32
glob2                     0.5
gradio                    3.41.2
gradio_client             0.5.0
h11                       0.12.0
handrefinerportable       2024.2.12.0
hitherdither              0.1.7
hsluv                     5.0.4
httpcore                  0.15.0
httptools                 0.6.1
httpx                     0.24.1
huggingface-hub           0.23.3
humanfriendly             10.0
idna                      3.7
imageio                   2.34.1
imageio-ffmpeg            0.5.1
importlib_metadata        7.1.0
importlib_resources       6.4.0
inflection                0.5.1
insightface               0.7.3
intel-openmp              2021.4.0
iopath                    0.1.9
jax                       0.4.28
jaxlib                    0.4.28
Jinja2                    3.1.3
jmespath                  0.10.0
joblib                    1.4.2
jsonmerge                 1.8.0
jsonschema                4.22.0
jsonschema-specifications 2023.12.1
kiwisolver                1.4.5
kornia                    0.6.7
kornia_rs                 0.1.3
lark                      1.1.2
lazy_loader               0.4
lightning-utilities       0.11.2
llvmlite                  0.42.0
lxml                      5.2.2
mapbox-earcut             1.0.1
Markdown                  3.6
markdown-it-py            3.0.0
MarkupSafe                2.1.5
matplotlib                3.9.0
mdurl                     0.1.2
mediapipe                 0.10.14
mkl                       2021.4.0
ml-dtypes                 0.4.0
mmcv                      2.1.0
mmdet                     3.3.0
mmengine                  0.10.4
model-index               0.1.11
moviepy                   1.0.2
mpmath                    1.3.0
multidict                 6.0.5
networkx                  3.2.1
numba                     0.59.1
numpy                     1.26.2
omegaconf                 2.2.3
onnx                      1.16.1
onnxruntime               1.18.0
open-clip-torch           2.20.0
opencv-contrib-python     4.10.0.82
opencv-python             4.10.0.82
opencv-python-headless    4.10.0.82
opendatalab               0.0.10
openmim                   0.3.9
openxlab                  0.1.0
opt-einsum                3.3.0
ordered-set               4.1.0
orjson                    3.10.3
oss2                      2.17.0
packaging                 24.0
pandas                    2.2.2
piexif                    1.1.3
Pillow                    9.5.0
pillow-avif-plugin        1.4.3
pip                       23.0.1
platformdirs              4.2.2
pooch                     1.8.2
portalocker               2.8.2
prettytable               3.10.0
proglog                   0.1.10
protobuf                  3.20.3
psutil                    5.9.5
py-cpuinfo                9.0.0
pycocotools               2.0.7
pycollada                 0.8
pycparser                 2.22
pycryptodome              3.20.0
pydantic                  1.10.15
pydantic_core             2.18.4
pydub                     0.25.1
Pygments                  2.18.0
PyMatting                 1.1.12
pyparsing                 3.1.2
pypng                     0.20220715.0
PyQt5                     5.15.10
PyQt5-Qt5                 5.15.2
PyQt5-sip                 12.13.0
pyreadline3               3.4.1
python-dateutil           2.9.0.post0
python-dotenv             1.0.1
python-multipart          0.0.9
pytorch-lightning         1.9.4
pytz                      2023.4
PyWavelets                1.6.0
pywin32                   306
PyYAML                    6.0.1
referencing               0.35.1
regex                     2024.5.15
rembg                     2.0.57
reportlab                 4.2.0
requests                  2.28.2
resize-right              0.0.2
rich                      13.4.2
rpds-py                   0.18.1
Rtree                     1.2.0
ruff                      0.4.8
safetensors               0.4.2
scikit-image              0.21.0
scikit-learn              1.5.0
scipy                     1.13.1
sdwi2iextender            0.1.3
seaborn                   0.13.2
segment-anything          1.0
semantic-version          2.10.0
sentencepiece             0.2.0
setuptools                69.5.1
shapely                   2.0.4
shellingham               1.5.4
six                       1.16.0
smmap                     5.0.1
sniffio                   1.3.1
sounddevice               0.4.7
spandrel                  0.1.6
starlette                 0.26.1
supervision               0.21.0
svg.path                  6.3
svglib                    1.5.1
sympy                     1.12
tabulate                  0.9.0
tbb                       2021.11.0
tensorboardX              2.6.2.2
termcolor                 2.4.0
terminaltables            3.1.10
threadpoolctl             3.5.0
tifffile                  2024.5.22
timm                      1.0.3
tinycss2                  1.3.0
tokenizers                0.13.3
tomesd                    0.1.3
tomli                     2.0.1
tomlkit                   0.12.0
toolz                     0.12.1
torch                     2.3.0+cu121
torchaudio                2.3.0+cu121
torchdiffeq               0.2.3
torchmetrics              1.4.0.post0
torchsde                  0.2.6
torchvision               0.18.0+cu121
tqdm                      4.65.2
trampoline                0.1.2
transformers              4.30.2
transforms3d              0.4.1
trimesh                   4.4.1
typer                     0.12.3
typing_extensions         4.9.0
tzdata                    2024.1
ujson                     5.10.0
ultralytics               8.2.28
ultralytics-thop          0.2.7
urllib3                   1.26.18
uvicorn                   0.30.1
vhacdx                    0.0.6
vispy                     0.14.2
watchfiles                0.22.0
wcwidth                   0.2.13
webencodings              0.5.1
websockets                11.0.3
wget                      3.2
xatlas                    0.0.9
xformers                  0.0.26.post1
xxhash                    3.4.1
yacs                      0.1.8
yapf                      0.40.2
yarl                      1.9.4
zipp                      3.19.2

But wait, maybe I have slow GPU or driver issue? Well, no.
ComfyUI:

checkpoint: ponyDiffusionV6XL.safetensors [67ab2fd8ec]
Euler a @ normal
768*896
steps: 20
cfg: 7
+: "1girl"
-: ""

got prompt
[rgthree] Using rgthree's optimized recursive execution.
100% 20/20 [00:04<00:00,  4.23it/s]
Prompt executed in 5.25 seconds

Turns out, 3080 RTX works perfectly fine.

So, question is, what in the world could possibly go wrong?

[iiiCpu]

Hm hm hm...
Switched to CUDA 11.8 and things became better.
version: v1.9.4  •  python: 3.10.11  •  torch: 2.3.0+cu118  •  xformers: 0.0.26.post1+cu118  •  gradio: 3.41.2  •  checkpoint: 67ab2fd8ec
Seems like --xformers option is obligatory. Without the option xformers were not available.

Now, for the same request it only takes [01:49<00:00, 5.20s/it]

This is hilarious.

[Epteak]

Hi, have you found the source of the issue and restored a normal generation speed? I have a similar problem to yours on my RTX 3080 laptop.

[iiiCpu]

It's not certain, so take it with a huge pale of salt. And pepper.

I switched to 3090 and now there's almost no difference between A1111 and Comfy. BUT!!! I don't believe switching to top-tear GPU is the only option.

Which makes me think it's something about having big ass VRAM (as it's the only significant difference between RTX 3080 10G and RTX 3090 24G). Which makes sense, as A1111 load loras quietly, sometimes even without keywords. Either this, or one have to clean install GPU driver.

So, I'd recommend you to use some tool like nVidia driver uninstaller to remove anything and everything driver related. And remove most of your models\loras\etc from A1111 folder to decrease overall number of models to work with. This might help.

[Epteak]

I've used DDU to uninstall NVIDIA drivers and the issue remains sadly. And since I'm using a clean install of Automatic1111 to investigate the problem, I only have one single model to load so it's not coming from this either. Furthermore, my RTX 3080 has 16Gb of VRAM so it can't really be a VRAM issue :/