Skip to content

Studio 4.8.2: clearer model-distribution guidance

Choose a tag to compare

@mahmoudyassine mahmoudyassine released this 18 Jul 11:28

Copy-level release following user feedback: it was not obvious that the Tensor parallel slider is what distributes the model and that workers beyond TP replicate it.

  • TP help text now states the rule directly: one copy of the weights spans TP GPUs; GPUs beyond TP form additional replicas that each load the full model.
  • The hardware meta card shows an explanatory note whenever replicas > 1.
  • The 'one replica cannot hold the model' recommendation explains copies-vs-room and names the exact fixes with numbers, including the TP value that fits one copy and the full-fleet TP that distributes a single copy.