Skip to content

refactor: add neverReenrich support and clean up worker structure#3837

Merged
skwowet merged 6 commits intomainfrom
improve/never-reenrich-flag
Feb 10, 2026
Merged

refactor: add neverReenrich support and clean up worker structure#3837
skwowet merged 6 commits intomainfrom
improve/never-reenrich-flag

Conversation

@skwowet
Copy link
Copy Markdown
Collaborator

@skwowet skwowet commented Feb 10, 2026

Note

Medium Risk
Touches enrichment selection criteria and cache invalidation semantics (including SQL query conditions), which can materially change which members/orgs get enriched and when. The remaining changes are mostly refactors/moves but could introduce runtime wiring issues if any imports/Temporal schedule IDs drift.

Overview
Adds neverReenrich support across member and organization enrichment sources: service/type contracts now allow cacheObsoleteAfterSeconds to be optional when neverReenrich is enabled, cache-obsolescence checks short-circuit when neverReenrich is true, and enrichment candidate queries (fetchMembersForEnrichment, fetchOrganizationsForEnrichment) treat such sources as enrich-once by only selecting entities with no existing cache row.

Refactors members_enrichment_worker structure by splitting LLM helpers into activities/llm.ts, consolidating member-related activities (including OpenSearch sync) into activities/member.ts and removing activities/syncEnrichedData.ts, routing workflows to import from the new activities barrel, and renaming/rewiring the top-level enrichment trigger workflow from getMembersToEnrich to triggerMembersEnrichment with schedules separated (new refreshMembersEnrichmentMaterializedViews schedule file). Also removes the onboarding script and its package scripts.

Written by Cursor Bugbot for commit 4710c1d. This will update automatically on new commits. Configure here.

@skwowet skwowet self-assigned this Feb 10, 2026
@github-actions

This comment was marked as spam.

3 similar comments
@github-actions

This comment was marked as spam.

@github-actions

This comment was marked as spam.

@github-actions
Copy link
Copy Markdown
Contributor

⚠️ Jira Issue Key Missing

Your PR title doesn't contain a Jira issue key. Consider adding it for better traceability.

Example:

  • feat: add user authentication (CM-123)
  • feat: add user authentication (IN-123)

Projects:

  • CM: Community Data Platform
  • IN: Insights

Please add a Jira issue key to your PR title.

@github-actions
Copy link
Copy Markdown
Contributor

⚠️ Jira Issue Key Missing

Your PR title doesn't contain a Jira issue key. Consider adding it for better traceability.

Example:

  • feat: add user authentication (CM-123)
  • feat: add user authentication (IN-123)

Projects:

  • CM: Community Data Platform
  • IN: Insights

Please add a Jira issue key to your PR title.

Copy link
Copy Markdown

@cursor cursor Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes and found 1 potential issue.

Comment thread services/libs/types/src/enrichment.ts
@github-actions
Copy link
Copy Markdown
Contributor

⚠️ Jira Issue Key Missing

Your PR title doesn't contain a Jira issue key. Consider adding it for better traceability.

Example:

  • feat: add user authentication (CM-123)
  • feat: add user authentication (IN-123)

Projects:

  • CM: Community Data Platform
  • IN: Insights

Please add a Jira issue key to your PR title.

@skwowet skwowet changed the title refactor: add neverReenrich flag to skip re-enrichment for one-time sources refactor: add neverReenrich support and clean up worker structure Feb 10, 2026
@github-actions
Copy link
Copy Markdown
Contributor

⚠️ Jira Issue Key Missing

Your PR title doesn't contain a Jira issue key. Consider adding it for better traceability.

Example:

  • feat: add user authentication (CM-123)
  • feat: add user authentication (IN-123)

Projects:

  • CM: Community Data Platform
  • IN: Insights

Please add a Jira issue key to your PR title.

1 similar comment
@github-actions
Copy link
Copy Markdown
Contributor

⚠️ Jira Issue Key Missing

Your PR title doesn't contain a Jira issue key. Consider adding it for better traceability.

Example:

  • feat: add user authentication (CM-123)
  • feat: add user authentication (IN-123)

Projects:

  • CM: Community Data Platform
  • IN: Insights

Please add a Jira issue key to your PR title.

@skwowet skwowet merged commit 8416a82 into main Feb 10, 2026
14 checks passed
@skwowet skwowet deleted the improve/never-reenrich-flag branch February 10, 2026 13:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant