Fix file friendly logging

[brendan-ai2]

@OyvindTafjord has identified a bug in our (formerly) file friendly logging that originated during the DistributedDataParallel additions. In short, --file-friendly-logging does not appear to work anymore.

To quote his Slack message:

Regarding the lack of file-friendly logging: I'm guessing it's the distributed code (#3529). As a workaround I hacked in the earlier code and that now works for my purposes (OyvindTafjord@8a1c7ad). I also note that another change was that the stderr.log file for better or worse used to record these tqdm statuses, but with the new code that doesn't seem to happen (maybe that was intentional, but occasionally I have made use of those to get a post-hoc rough "training curve", although when using beaker those are also in the main beaker log).

[dirkgr]

Should be fixed with #3519.

[schmmd]

@dirkgr thanks--I have not had time to look at this yet...

[matt-gardner]

@schmmd, we talked about this in our issue triage, and thought it should be covered by work I'm planning for #3519, so you shouldn't have to worry about this.

[schmmd]

How would we validate that this is indeed fixed now that #3519 is merged?

[DeNeutoy]

Now the issue that this is tracking with is #3913 , so it isn't fixed yet...

[schmmd]

This is independent of the other PRs and needs attention.

[matt-gardner]

Because there's some example code already that probably fixes the issue, I'm giving this one a "day" label. Could be much less, if that example code just works without much effort, I just don't know.