Can zero++ be used in only one machine (with multiple GPUs)?

[henryxiao1997]

I see in the paper it takes hundreds of GPUs (definitely multiple machines) in the experiments. I wonder whether zero++ can speed up the training with only one machine comparing with zero3?

Thanks!