Tomesd is not reducing the total memory consumption.

[brappier]

When i use Diffusors without tomesd the total memory usage in nvidia-smi is 3966MiB.
But when i use it with tomesd ( using the example in the readme ) , the usage on nvidia-smi is still the same.

Any idea whats happening?

[reynoldscem]

Yes I experience this too

[dbolya]

I believe someone looked into this before and found that diffusers was already using memory efficient attention, which saves most of the memory that ToMe would have saved anyway. The numbers in the paper are for the original implementation of stable diffusion.