Skip to content

feat(cdp): introduce hogwatcher for transforms#30217

Merged
meikelmosby merged 72 commits intomasterfrom
feat/meikel/introduce-hogwatcher-for-transforms
Mar 26, 2025
Merged

feat(cdp): introduce hogwatcher for transforms#30217
meikelmosby merged 72 commits intomasterfrom
feat/meikel/introduce-hogwatcher-for-transforms

Conversation

@meikelmosby
Copy link
Contributor

@meikelmosby meikelmosby commented Mar 20, 2025

Problem

we want transformations to also be degraded if they are bad functions that would harm over time. for now we only want to log out if we would have disabled a functions but not actually skip it as we just want to get a feeling for it. we also track the execution time for each operation to get a feeling if we can run this in our production pipeline or if the calls to redis would be too expensive and would eventually slow down ingestion a lot.

Changes

  • added hogwatcher for transformations
  • added metric to see how much overhead its adding per event
  • added a flag to turn it off and on

👉 Stay up-to-date with PostHog coding conventions for a smoother review.

Does this work well for both Cloud and self-hosted?

How did you test this code?

  • added tests

Base automatically changed from feat/meikel/filters-in-hog-transforms to master March 21, 2025 14:35
…ce-hogwatcher-for-transforms

# Conflicts:
#	plugin-server/src/cdp/hog-transformations/hog-transformer.service.test.ts
#	plugin-server/src/cdp/hog-transformations/hog-transformer.service.ts
#	plugin-server/src/config/config.ts
@github-actions
Copy link
Contributor

Size Change: +3.78 kB (+0.04%)

Total Size: 9.75 MB

Filename Size Change
frontend/dist/toolbar.js 9.75 MB +3.78 kB (+0.04%)

compressed-size-action

@meikelmosby meikelmosby requested a review from pl March 26, 2025 09:23
@meikelmosby meikelmosby dismissed benjackwhite’s stale review March 26, 2025 09:44

You were on vacy and pawel did the review.

@meikelmosby meikelmosby merged commit 76e9ddf into master Mar 26, 2025
96 checks passed
@meikelmosby meikelmosby deleted the feat/meikel/introduce-hogwatcher-for-transforms branch March 26, 2025 09:44
meikelmosby added a commit that referenced this pull request Mar 26, 2025
@meikelmosby meikelmosby restored the feat/meikel/introduce-hogwatcher-for-transforms branch March 26, 2025 13:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants