Too many urls in greqests.map causes gevent.hub.LoopExit only on mac

[mnowotka]

Detailed description is in this SO question: https://stackoverflow.com/questions/23117176/too-many-urls-in-greqests-map-causes-gevent-hub-loopexit-only-on-mac , but I will answer any questions in comments to this issue if needed.

[rtdean]

From SO:

ret = grequests.map(rs, size=50)

What is rs? I've only seen this happen when feeding grequests a queue object, and not putting StopIteration at the end of the queue... eventually, everything is processed, nothing else is running in parallel, and the parent job would go to sleep, except there is nothing else running that can possibly get appended to the queue, so that exception is raised.

[kennethreitz]

From SO:

It turned out that each request was executed in separate session. This was clearly not what I wanted so after solving this and sharing one session between all requests, the code is faster and doesn't give deadlocks anymore. On the other hand executing each requests in separate session should cause any problems (appart from being extremely inefficient) so thank you for the info.

May need to revisit that.