Wan 1.3B and 14B DiT full finetune

[zlyzg]

Great work! I am wondering if current Simpletuner suppports full finetuning of Wan's DiT. Thanks!

[bghira]

yes 👍 though FSDP2 isn't tested.

[bghira]

@zlyzg you'll want to try making use of TREAD when you do this. see the dedicated document for that or the wan quickstart subsection.

[bghira]

RamTorch, Musubi blocks to swap, FSDP2 and group offload are available now. though, in order of reliability.