Required GPU memory?

[rgga-16]

What is the minimum amount of GPU memory needed to run this model on inference?

[IeatToilets]

It depends on your needs and the amount of load. But I'd recommend anything above 4GB GPU memory it's the standard these days add more if you're planning for a very very heavy usage.

[zky001]

yesterday I try set batch_size to 12,used 11.5G GPU memory

[deepak-1530]

I am using Shap-e on a V100 machine. For a batch size of 4 (image to 3D), it is taking around 13GB GPU memory.