fix(mmlu): shard batches over expert-DP group for MoE models#1966
Closed
ChenhanYu wants to merge 1 commit into
Closed
fix(mmlu): shard batches over expert-DP group for MoE models#1966ChenhanYu wants to merge 1 commit into
ChenhanYu wants to merge 1 commit into
Loading