cant use zero-offload

[yanqiangmiffy]

assert not args.offload, "zero-offload is not currently supported but coming soon!"

[yaozhewei]

Hi @yanqiangmiffy , we are working on this.

[yanqiangmiffy]

Thanks！Looking forward to your work

[zhangyanbo2007]

@yaozhewei 可以了吗？急用

[zhihao-chen]

@yaozhewei Why can't we use zero-offload? Can you tell me the specific reason? I can successfully enable zero-offload。

[yanqiangmiffy]

Is this ok？

[chenyaofo]

I am also curious as to why the current version does not support the zero-offload feature. This seems to be a basic functionality powered by the deepspeed library, and it could be easily integrated into the codebase. Are there any conflicts with other components that prevent its implementation?

[awan-10]

This is now supported: #553

[chenyaofo]

This is now supported: #553

Thanks for the great efforts that have been made