Add progress bar for WARC file processing

[MaxDall]

This PR:

• adds a bar to display the progression of WARC file processing
• add a parameter to CCNewsCrawler to disable progress bars

[addie9800]

This looks really good. Thanks for adding it. There is one question I have though: do you think it's easily possible to force the progressbar to be at the bottom of the output? Because if there are things printed to stdout, it gets lost pretty quickly. I tried playing around with it a bit, but there doesn't seem to be a quick fix.

[MaxDall]

do you think it's easily possible to force the progressbar to be at the bottom of the output?

No, I can't think of an easy or even practical solution for this. An alternative is always to disable tqdm.
Maybe this can help?

[addie9800]

do you think it's easily possible to force the progressbar to be at the bottom of the output?

No, I can't think of an easy or even practical solution for this. An alternative is always to disable tqdm. Maybe this can help?

I tried it, but it doesn't really work, maybe because of the multiprocessing, I'm not sure. Disabling wouldn't help either, since I thought it would be nice to always have the current progess visible, even if logging is set to a broader level or the usage involves printing. But it's also not that important.