Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement flags to control retry delays #83

Merged
merged 1 commit into from
Jan 13, 2021
Merged

Implement flags to control retry delays #83

merged 1 commit into from
Jan 13, 2021

Conversation

hansmi
Copy link
Contributor

@hansmi hansmi commented Jun 15, 2020

Add two new flags, "--proxy.retry.initial-wait" and
"--proxy.retry.max-wait", controlling how long to sleep after
encountering a proxy poll failure (i.e. network timeout). An
exponential, randomized backoff algorithm is used to prevent thundering
herds. Discussed in #82.

@SuperQ
Copy link
Contributor

SuperQ commented Jun 16, 2020

In order to add the new external package, you will need to include the go modules and go mod vendor changes.

@hansmi
Copy link
Contributor Author

hansmi commented Jun 16, 2020

[…] you will need to include the go modules and go mod vendor changes.

Of course. I somehow missed them in my git add. Also updated the commit message with more details.

@hansmi hansmi mentioned this pull request Jan 5, 2021
@SuperQ
Copy link
Contributor

SuperQ commented Jan 6, 2021

You can now rebase against head with the removed vendor dir.

Amend the client with two new flags, "--proxy.retry.initial-wait" and
"--proxy.retry.max-wait", controlling how long to sleep after
encountering a proxy poll failure (i.e. network timeout). An
exponential, randomized backoff algorithm is used to prevent thundering
herds. The initial wait is raised from 50ms to 1s. In practice waiting
less than a second after a failure is rarely useful and prevents the
server from being hammered with up to three requests in the second after
a failure.

Discussed in #82.

Signed-off-by: Michael Hanselmann <public@hansmi.ch>
@hansmi
Copy link
Contributor Author

hansmi commented Jan 6, 2021

@SuperQ done, rebased on top of master.

@SuperQ SuperQ self-requested a review January 6, 2021 14:42
Copy link
Contributor

@SuperQ SuperQ left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, Thanks

@SuperQ SuperQ merged commit 5cce876 into prometheus-community:master Jan 13, 2021
SuperQ added a commit that referenced this pull request Mar 28, 2024
* [FEATURE] Implement flags to control retry delays #83
* [ENHANCEMENT] Add scrape_id to error log #120
* [BUGFIX] /clients endpoint return application/json as Content-Type #121

Signed-off-by: SuperQ <superq@gmail.com>
@SuperQ SuperQ mentioned this pull request Mar 28, 2024
SuperQ added a commit that referenced this pull request Mar 29, 2024
* [FEATURE] Implement flags to control retry delays #83
* [ENHANCEMENT] Add scrape_id to error log #120
* [BUGFIX] /clients endpoint return application/json as Content-Type #121

Signed-off-by: SuperQ <superq@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants