Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Info level is too chatty for this sleep message, debug is good with new metrics to show when retries and errors happen #43

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

komealy
Copy link

@komealy komealy commented Apr 20, 2023

Having this in Info level produces thousands of messages per minute in a production level stream that is operating appropriately. Knowing this for debug purposes is good enough. We shouldn't be overloading log processing pipelines with this much repetitive spam in info level. We can expose these details in metrics instead.

Resolves #40

Also refactoring to satisfy go-staticcheck
image

@komealy komealy force-pushed the vmware/ko-change-sleep-messages-to-debug branch from a82c42e to 24c7ea4 Compare April 21, 2023 13:10
@komealy komealy changed the title Info level is too chatty for this sleep message, debug is good Info level is too chatty for this sleep message, debug is good with new metrics to show when retries and errors happen Apr 21, 2023
…with new metrics

Signed-off-by: Kris O'Mealy <komealy@hotmail.com>

Include new metrics for backoffs, retries, and errors around the get records calls

Signed-off-by: Kris O'Mealy <komealy@hotmail.com>

fix: have to actually register the new metrics for prometheus

Signed-off-by: Kris O'Mealy <komealy@hotmail.com>
@komealy komealy force-pushed the vmware/ko-change-sleep-messages-to-debug branch from 24c7ea4 to f314f76 Compare April 22, 2023 15:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

localTPSExceededError so sleep for a second spams the log output
1 participant