Parallel Inference support ffor Dit model

[enozhu]

does diffusers have any plan to support Parallel Inference like TP/PP/SP？

[a-r-r-o-w]

Nope, Diffusers does not support TP/SP at the moment. You can get PP to work more easily though and there are examples available for that.

We do plan to eventually support TP/SP (cc @yiyixuxu). For now, good reference would be ParaAttention by chengzeyi

[enozhu]

thanks for replying, any plan to support cpp(chunked pipeline parallel)? like pipefusion in xdit, It seems faster than common pipeline parrallel

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.