Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

internal: Change trace too large message to debug #1403

Merged

Conversation

ZStriker19
Copy link
Contributor

@ZStriker19 ZStriker19 commented May 5, 2020

Essentially the issue is that we don't accept logs bigger than 256kb: "Any log exceeding 256KB is accepted and truncated by server" and when we log that a trace payload is too large, we print the whole trace, causing a log larger than the acceptable size: https://github.com/DataDog/dd-trace-py/blob/master/ddtrace/api.py#L229

This causes many error level logs to be generated

Which is causing the customer's monitor for error level logs on this application to alert.

@ZStriker19 ZStriker19 requested a review from a team as a code owner May 5, 2020 17:20
ddtrace/api.py Outdated Show resolved Hide resolved
@brettlangdon brettlangdon changed the title zach groves changing log level for log that's larger than 256kb internal: Change trace too large message to debug May 5, 2020
@ZStriker19
Copy link
Contributor Author

Let me know if you'd rather have something like the trace id of the parent span or something printed when this error occurs. I was not sure how to add that instead from the Trace object.

@jd
Copy link
Contributor

jd commented May 14, 2020

I think that's good enough. That should not happen anyhow, and I don't think having any id will help. 🤷 Thank you @ZStriker19!

@jd jd merged commit ed831e4 into master May 14, 2020
@jd jd deleted the zach-groves-change-log-level-for-log-that's-larger-than-256kb branch May 14, 2020 13:03
@Kyle-Verhoog Kyle-Verhoog added this to the 0.38.0 milestone May 15, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants