paws.storage::get_object curl timingout

[DyfanJones]

HI all,

Has there been a major change between paws.database 0.1.9 and 0.1.10? Currently a user from the noctua package is getting a timeout issue (DyfanJones/noctua#132).

Any advice would be greatly appreciated :)

[DyfanJones]

To help this issue I have done a breakdown of the noctua wrapper method of dbGetQuery to help identify the possible issue. DyfanJones/noctua#132 (comment)

From this I believe the best culprit would be paws.storage::s3()$get_objects when it makes it's curl call to s3 and ultimately gets a timeout error

Error in curl::curl_fetch_memory(url, handle = handle): Timeout was reached: [REDACTED.s3.us-east-2.amazonaws.com] Operation timed out after 10000 milliseconds with 119006796 out of 316782524 bytes received

[DyfanJones]

I believe the issue stems from this commit: c65e813 . Where new_http_request gets a timeout of 10 seconds.

[davidkretch]

Hey, sorry about that! We've updated paws.common on CRAN to have no default timeout again. With the fix we are able to download large files that take >10 seconds.

[DyfanJones]

@davidkretch thanks for the fast fix. I will close this now 😄