Visualize loss surface in random directions (1st & 2nd picture) or between model checkpoints (3rd picture).
Visualize path that optimizer took during training (4th picture).
Visualize loss surface in random directions (1st & 2nd picture) or between model checkpoints (3rd picture).
Visualize path that optimizer took during training (4th picture).