Skip to content
Branch: master
Find file History
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Type Name Latest commit message Commit time
Failed to load latest commit information.

wandb sweeps mpi wrapper scripts


Demonstrating how to use sweeps with mpi frameworks


  1. modify outer wrapper split_command variable to match how you want to call your training program

By default the script assumes that the script is called and that you are not passing any commandline arguments.

  1. specify outer wrapper as program in the sweep configuration yaml file
method: grid
  1. launch your sweep


These wrapper scripts allow wandb to pass UNIX signals across mpi frameworks. Signals are used when manually stopping runs from the UI or using the early_terminate sweeps feature.

The outer wrapper catches SIGTERM and uses SIGUSR1 to pass to the inner wrapper. The inner wrapper catches SIGUSR1 and passes SIGTERM to the user training script. This is required because mpi frameworks typically do not pass SIGTERM to child processes.

You can’t perform that action at this time.