Use lib "requests" for downloading

[jmansilla]

I'm right now making use of https://pypi.python.org/pypi/requests-cache which creates a cache of the downloaded stuff magically, and it's awesome. So, I would like to be able to take advantage of it using demiurge.

I don't know if just as an option or as a replacement of pyquery downloader.

What do you think?

[matiasb]

PyQuery will make use of requests if available (https://pythonhosted.org/pyquery/scrap.html), and so is demiurge (you can even specify requests params as Item meta options, like auth or headers).

So, if you install requests-cache in your env and set it up as usual, all demiurge (ie. PyQuery) requests should go through requests and be cached. At least that's what I would expect :-)
Didn't try yet, let me know if you can confirm that.

[jmansilla]

Ups. You are right.

Thanks Mati.