Full PyTorch experiment tracking with support for DP/DDP & APEX AMP
AIToolbox training setup with automatic experiment tracking.
With this release, TrainLoop supports in addition to the single GPU and DataParallel training also the DistributedDataParallel multi-GPU setting.
Furthermore this release also fully enables mixed-precision training via Nvidia APEX for both single GPU as well as multi-GPU training settings.