You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
i want to trin on multi-node. is it necessary to copy preprocessed dataset file and tokenizer to all nodes? or all nodes read these files from master node?
The text was updated successfully, but these errors were encountered:
Typically we store them in a shared file storage system that every node has access to, but if you are training multi-node and require locally storage data then yes you'll need to share them across the storage systems.
i want to trin on multi-node. is it necessary to copy preprocessed dataset file and tokenizer to all nodes? or all nodes read these files from master node?
The text was updated successfully, but these errors were encountered: