-
Notifications
You must be signed in to change notification settings - Fork 6
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
tune RANGE_REQ_SIZE #3
Comments
The current urlfetch quotas impose a maximum rate of 22MB of bandwidth consumed per minute. So with our current RANGE_REQ_SIZE of ~32MB (the current max App Engine response size), we exceed the per-minute quota after a single (non-range) request for a sufficiently large resource. Assuming the destination server supports range requests, the more we lower RANGE_REQ_SIZE, the more requests we'll be unable to fulfill in a single response for clients making regular, non-range requests under the assumption that we can serve larger responses, i.e. pre- getlantern/lantern#243 -fixed versions of Lantern. |
@myleshorton, @forkner: Given the above, would lowering RANGE_REQ_SIZE to Lantern's new chunk size (2,000,000 bytes) make sense, or since Lantern will now only be making range requests of this size anyway, should laeproxy stick with a larger RANGE_REQ_SIZE to support older versions? |
Yeah, those quotas are annoying -- definitely hit up against that in my testing. I'm not too worried about old Lantern versions -- I say set it to the current Lantern chunk size. Any way to return to Lantern more detailed quota info so Lantern can request future chunks from somewhere else when getting close to quota? Really need app engine premiere. |
When a Range header is not sent by the upstream requester, laeproxy requests a range of ~32MB, the current maximum App Engine response size. Because App Engine apps cannot send urlfetch responses until they've been completely downloaded into memory, the agent downstream can experience lag (in particular when the destination server is slow).
Relevant App Engine feature requests:
http://code.google.com/p/googleappengine/issues/detail?id=1903
http://code.google.com/p/googleappengine/issues/detail?id=4888
The text was updated successfully, but these errors were encountered: