Ascync non-blocking?

[jakehilton]

Is it possible to initialize a pool to return the result but continue the code execution like so?

import grequests

def print_res(res, *args, **kwargs):
    from pprint import pprint
    pprint (vars(res))

print 'starting grequest'

req = grequests.post('http://www.cricket.com.au/', hooks=dict(response=print_res))
job = grequests.send(req, grequests.Pool(1))

print 'request made'

for i in range(10):
    print i

So that would show the request was made but still print the range while the request was in process and then finally print out the results of the send?

I'd really love to use grequests but the examples/documentation are fairly sparse so I'm struggling.

Thanks for any help.

[kennethreitz]

You should be able to use grequests.get(..., callback=print_res).

[jakehilton]

The problem is not that the callback wasn't being called.. it's that it's blocking on the .send. Am I misunderstanding that it shouldn't block when using the Pool? I would expect it to log something like so:

starting grequest
request made
1
2
3
<http content back>
4
5
6
7
8
9
10

Instead it blocks and the content is printed out before the request made log is logged.

[RavisMsk]

@jakehilton

Hey Jake,

This library is blocking calling thread, so it's not as asynchronous as you could think. It's like half-asynchronous, dunno how to call that...
I think lots of people actually think it'll send the HTTP task to separate thread-pool and eventually call back with results, but it doesn't. Yes, it sends multiple requests, which are asynchronous TO EACH OTHER, and awaits them (https://github.com/kennethreitz/grequests/blob/master/grequests.py#L117).
And that is really confusing. I think authors should clarify that in docs.

[Lythimus]

@RavisMsk Jake isn't using the map function, he's using the send function, which is supposedly asynchronous, unlike map which is only async in that it will block on receiving responses from a group of async requests.

[svenyonson]

Any updates on this? I need to send a single request, asynchronously, so as not to block the main thread, and be called back when the request completes.

[svenyonson]

I'm getting the same results as Jake. My post request is blocking.
xyz = grequests.post('https://xyz.com/', data = data, headers = headers, callback=my_reply).send()

[kennethreitz]

this library is not actively maintained.

[kennethreitz]

From the readme: Note: You should probably use requests-threads or requests-futures instead.