progressbar with tqdm

[PhilipMay]

I added the progressbar. See #454
It can not be turned off and is on by default.
But I can add this if wanted.

The progressbar also shows the best (lowest loss).

Would be happy for feedback.

Philip

[maxpumperla]

@PhilipMay very cool, thanks for this. don't see a reason not to have it on by default, but it might be good to have a switch to turn it off. I have a lib or two that have hyperopt as dependency and I'm worried that this might clutter the output unfavourably in between other stuff.

btw, how does this look in distributed setup (mongo etc.)?

[PhilipMay]

I am working on it. Will tell you when I am done.
The distributed setup (mongo etc.) should work too. I will investigate it.

[maxpumperla]

awesome, looking forward to it.

[PhilipMay]

I have a lib or two that have hyperopt as dependency and I'm worried that this might clutter the output unfavourably in between other stuff.

@maxpumperla I added a redirect that will avoid this type of clutter. See here: 63a44e5

All your normal printoutput will not break the progressbar. The progressbar will always stay on the bottom. The text will look like scrolling on top of the progressbar. But never below or beneath.

The Progressbar also shows the best (minimum) loss it has found.

Like this:

Normal print statements will always show up here.
And here.
And so on...
100%|██████████████████| 2/2 [00:02<00:00,  1.01s/it, best loss: 36.8200744761246]

[PhilipMay]

btw, how does this look in distributed setup (mongo etc.)?

Well, for mongo you pass a MongoTrials object to fmin instead of a "normal" Trials object. See here: https://github.com/hyperopt/hyperopt/wiki/Parallelizing-Evaluations-During-Search-via-MongoDB#2-use-mongotrials

I am pretty sure that they are handled by the same loop that is inside my progress bar. So yes it should work.

[PhilipMay]

I am done with my work here with the PR.

The python 2.7 build is still broken though. :-(
What do you suggest?

[PhilipMay]

When should I extend the documentation? https://github.com/hyperopt/hyperopt.github.io
After release?

[maxpumperla]

@PhilipMay I tested locally, works with 2.7. Let's fix travis after this PR. Same goes for docs.

Thanks for the contribution, please keep it up! :)

[PhilipMay]

Was fun to implement it and discuss it here. ! :-)

[trevorwelch]

Thankful for this! Great job!

[uduse]

This is a nice feature to have, but unexpected output like this breaks doctests. Before this PR, I managed to silence hyperopt's output by setting the logger verbose level. However, it no longer works now. Since I also think having show_progressbar=True by default is a great idea, I suggest instead of using plain tqdm, pass tqdm to the logger so that projects do not care about hyperopt's output get this nice feature, and projects fiddled with hyperopt's logger level have consistent output behavior.