update with multi-node mode

[deep-diver]

This PR extends the existing example on Alignment Handbook on multiple node configurations.

[peterschmidt85]

@deep-diver I don't see the multi-node task configuration

[peterschmidt85]

Just curious, why 1..2? Shall it be 24GB:2?

[deep-diver]

Sure. No problem!
If there is a way to configure this at runtime, that would be much better IMO

[peterschmidt85]

My preference is always the declarative approach over runtime. In the runtime, the user always can override if needed.

[deep-diver]

@deep-diver I don't see the multi-node task configuration

What do you mean?

[peterschmidt85]

What do you mean?
@deep-diver I mean you have only train.dstack.yaml with a single node but you don't have a train-distrib.dstack.yaml with multiple nodes as well as other configuration files.
As a user how do I run the multi-node configuration with a single command without writing the configuration file myself?

[deep-diver]

@peterschmidt85 updated!