Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow customizing keep-alive and request timeouts for endpoint servers #7419

Merged

Conversation

tangledbytes
Copy link
Member

Explain the changes

This PR adds 2 configurations to endpoints, the intention is to allow the users to configure these timeouts based on their environments. For example, in a case where a NooBaa deployment is behind a horribly excruciatingly slow VPN, in those cases the user might want to tweak these values.

NOTE: This still requires cooperation from the AWS client. So it is important for the client to use --cli-read-timeout and --cli-connect-timeout.

Testing Instructions:

  1. Introduce network throttling.
  2. Spin up NooBaa.
  3. Run aws s3api --endpoint <val> put-object ... should run just fine provided the timeouts are correctly set.
  • Doc added/updated
  • Tests added

@tangledbytes
Copy link
Member Author

@guymguym I haven't added any keepAliveEnabled because I think keep-alive: true can only be set for http.Agent and not for servers.

@guymguym
Copy link
Member

guymguym commented Aug 1, 2023

@Utkarsh-pro perhaps add these configs to standalone.md too with recommended values for TMFS?

@guymguym guymguym force-pushed the utkarsh-pro/temp/timout-work branch from af33f3a to c9bf18b Compare August 1, 2023 20:35
@guymguym
Copy link
Member

guymguym commented Aug 1, 2023

@Utkarsh-pro Notice I rebased your branch (utkarsh-pro:utkarsh-pro/temp/timout-work) you will need to use "the force" to push/pull it to your clone

Signed-off-by: Utkarsh Srivastava <srivastavautkarsh8097@gmail.com>

allow customizing keepAlive and request timeouts for endpoint servers

Signed-off-by: Utkarsh Srivastava <srivastavautkarsh8097@gmail.com>

remove test throttling

Signed-off-by: Utkarsh Srivastava <srivastavautkarsh8097@gmail.com>

add recommeded values to standalone doc

Signed-off-by: Utkarsh Srivastava <srivastavautkarsh8097@gmail.com>

allow customizing keepAlive and request timeouts for endpoint servers

Signed-off-by: Utkarsh Srivastava <srivastavautkarsh8097@gmail.com>

allow customizing keepAlive and request timeouts for endpoint servers

Signed-off-by: Utkarsh Srivastava <srivastavautkarsh8097@gmail.com>

remove test throttling

Signed-off-by: Utkarsh Srivastava <srivastavautkarsh8097@gmail.com>
@tangledbytes
Copy link
Member Author

@guymguym, I have added 15 mins as request timeout (with 3 retries this should give us about 45 mins) and 1 minute as keep alive timeout for TMFS.

@tangledbytes tangledbytes merged commit 5c627e3 into noobaa:master Aug 2, 2023
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants