Skip to content

How to disable 'smart memory management' when using GGUF? #14481

Description

@bbaudio-2025

Custom Node Testing

Your question

I'm running Scail2 GGUF Q4, with the higher resolution 1280x720, comfyui seems enable VRAM offload automatically even there is some free VRAM. I have tried add '--disable-smart-memory' in bat file but not worked.

Logs

[INFO] Total VRAM 24563 MB, total RAM 65422 MB
[INFO] pytorch version: 2.7.0+cu128
[INFO] xformers version: 0.0.30
[INFO] Set vram state to: NORMAL_VRAM
[INFO] Disabling smart memory management
[INFO] Device: cuda:0 NVIDIA GeForce RTX 3090 Ti : cudaMallocAsync
[INFO] Using async weight offloading with 2 streams
[INFO] Enabled pinned memory 26168.0
[INFO] Using xformers attention
[WARNING] Unsupported Pytorch detected. DynamicVRAM support requires Pytorch version 2.8 or later. Falling back to legacy ModelPatcher. VRAM estimates may be unreliable especially on Windows
[INFO] Python version: 3.12.7 (tags/v3.12.7:0b05ead, Oct  1 2024, 03:06:41) [MSC v.1941 64 bit (AMD64)]
[INFO] ComfyUI version: 0.24.0
[INFO] comfy-aimdo version: 0.4.9
[INFO] comfy-kitchen version: 0.2.10
[INFO] comfyui-frontend-package version: 1.45.15
[INFO] comfyui-workflow-templates version: 0.9.98
[INFO] comfyui-embedded-docs version: 0.5.3
[INFO] comfy-kitchen version: 0.2.10
[INFO] comfy-aimdo version: 0.4.9
[INFO] [Prompt Server] web root: D:\AI\ComfyUI_windows_portable\python_embeded\Lib\site-packages\comfyui_frontend_package\static
[INFO] Asset seeder disabled

Other

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    User SupportA user needs help with something, probably not a bug.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions