Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ref(delayed rules): Add instrumentation #70693

Merged
merged 2 commits into from
May 13, 2024

Conversation

ceorourke
Copy link
Member

Add instrumentation and logging to the delayed rule processor to measure how long the bulkier functions are taking and how many rules and groups we're processing.

Closes https://getsentry.atlassian.net/browse/ALRT-19 and https://github.com/getsentry/team-core-product-foundations/issues/308 (a dupe) as a follow up to #69830 (review)

@github-actions github-actions bot added the Scope: Backend Automatically applied to PRs that change backend components label May 10, 2024
Copy link
Contributor

@saponifi3d saponifi3d left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

logger.info(
"delayed_processing.last_active",
extra={"last_active": status.last_active, "freq_offset": freq_offset},
with metrics.timer("delayed_processing.fire_rules.duration"):
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

just so i can understand, what's the difference between a timer and a span in these cases? is one better than the other?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think it's just sentry vs datadog

@ceorourke ceorourke merged commit 9ff054d into master May 13, 2024
47 of 48 checks passed
@ceorourke ceorourke deleted the ceorourke/delayed-processor-instrumentation branch May 13, 2024 19:26
Copy link

sentry-io bot commented May 22, 2024

Suspect Issues

This pull request was deployed and Sentry observed the following issues:

  • ‼️ SoftTimeLimitExceeded: SoftTimeLimitExceeded() sentry.rules.processing.delayed_processing View Issue

Did you find this useful? React with a 👍 or 👎

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Scope: Backend Automatically applied to PRs that change backend components
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants