Configurable request timeout

[suzukieng]

Community Note

• Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
• Please do not leave "+1" or "me too" comments, they generate extra noise for issue followers and do * not help prioritize the request
  If you are interested in working on this issue or have submitted a pull request, please leave a comment

Tell us about your request

Currently AppRunner enforces a 30 second timeout on HTTP requests. If the timeout is hit, a HTTP 503 response is returned.

For some use cases, especially large file uploads, this is a severe limitation.

Describe alternatives you've considered

We first refactored our file upload to use S3 multi-part uploads to break the upload request into several shorter requests. But then we ran into the problem that the S3 complete_multipart_upload call can take a long time (several minutes) to complete.
We are now considering having the user upload directly to S3, and then notifying the AppRunner service of the completed upload. If that avenue is unsuccessful, we will move to EC2, but that would be a shame as AppRunner has worked well for us so far.

Additional context

AWS support case ID (9433361761)

Attachments

Behavior can be easily triggered by calling something that takes longer than 30 seconds (in this case, a dummy "sleep" route)

> GET /sleep?seconds=31 HTTP/1.1
> Host: xxxx.eu-west-1.awsapprunner.com
> User-Agent: curl/7.64.1
> Accept: */*
> 
< HTTP/1.1 503 Service Unavailable
< content-length: 95
< content-type: text/plain
< date: Mon, 03 Jan 2022 07:39:44 GMT
< server: envoy

[haversnail]

In addition to 👍'ing, it seems that this issue is the root cause of other high-demand issues in this repo — referencing them here in an effort to consolidate:
#13
#23
#86

[suzukieng]

This feature request has been open for over a year now (refering to #13).
No official comment, no timeline, nothing. Come on.

[yimipeng]

WIP

[amitgupta85]

Thanks for your patience. What would be a reasonable maximum request time out value that you would like to get supported in App Runner?

[jvisker]

Thanks for your patience. What would be a reasonable maximum request time out value that you would like to get supported in App Runner?

Ideally it could go as long as an ALB can. However most HTTP calls I work with are 2 minutes or less (usually much shorter).

[haversnail]

Thanks for your patience. What would be a reasonable maximum request time out value that you would like to get supported in App Runner?

Is this something that could still be configurable? Similar to what @jvisker said, ideally this would match the min/max/default timeout of ALB or CloudFront or similar (1/60/30 respectively, IIRC).

For WebSockets and Server-Sent Events, you would also want the connection to remain open as long as data is being sent across that connection — in my first pass using AppRunner and SSE, I noticed that the connection timeout was not being reset even when data was in fact being sent within the timeout period. (Happy to open another issue for that if need be, though I was hoping it would resolve itself once this, #13 and/or #23 are resolved).

[houston3]

+1 for configurable timeout. Maximum value should be at least 5 minutes

[amitgupta85]

Can you tell us more about your use case?

[houston3]

At the moment we use Fargate for legacy applications that can't use lambda due to lambda/apigw limits (timeout/request size etc). We'd like to move them to App Runner. The applications deal with e.g. large file uploads, complex db queries and slow connections.

[snnles]

Hello everyone, Thank you for your feedback and patience on this issue. We have increased the request read timeout in App Runner from 30 seconds to 120 seconds.

We will keep this issue open to continue our conversation as work through increasing the timeout limits and making it configurable for you. Appreciate all your feedback!

Documentation link: https://docs.aws.amazon.com/apprunner/latest/dg/develop.html#develop.considerations

[dlo]

@snnles This is great, but we're still seeing consistent 30s timeouts on our App Runner instances. Is this a slow rollout, or is there something we need to do to explicitly configure this?

[amitgupta85]

Have you done any deployments since this feature launch? This requires a new deployment on your service after the feature launch.

[bnicholl]

For my use case, I plan on using App runner as the front end of a web app that is loading a rather large CSV file via user input, and continuously sending data in batches to sagemaker for ML inference. So when the SageMaker endpoint completes inference on the given batch, the App runner service collects more data from the CSV, then sends to sagemaker. Because of this, I'd need app runner to reset the request read timeout every time a sagemaker batch completes and the app runner service begins running again. Does app runner currently achieve this? If not, is this applicability in the works?