[tests] fix group offloading with disk tests#13491

sayakpaul merged 3 commits into

mainhuggingface/diffusers:mainfrom

fix-group-offloading-disk-testshuggingface/diffusers:fix-group-offloading-disk-testsCopy head branch name to clipboard