Skip to content

fix: mentions snowflake sink#3794

Merged
gaspergrom merged 1 commit intomainfrom
fix/mentions-sink
Jan 29, 2026
Merged

fix: mentions snowflake sink#3794
gaspergrom merged 1 commit intomainfrom
fix/mentions-sink

Conversation

@gaspergrom
Copy link
Copy Markdown
Contributor

@gaspergrom gaspergrom commented Jan 29, 2026

Note

Medium Risk
Changes the Snowflake/Kafka export from full snapshots to a time-windowed incremental sync based on createdAt, which can drop or duplicate data if timestamps or schedules drift. Also extends the exported schema, requiring downstream consumers to handle new columns.

Overview
Updates the mentions Tinybird datasource schema to include authorFollowerCount and tags.

Modifies the octolens_mentions_sink pipe to export these new fields and switches the daily Kafka/Snowflake export from a full snapshot to an incremental pull using a createdAt previous-day window filter.

Written by Cursor Bugbot for commit 98465c8. This will update automatically on new commits. Configure here.

Signed-off-by: Gašper Grom <gasper.grom@gmail.com>
@gaspergrom gaspergrom self-assigned this Jan 29, 2026
@github-actions
Copy link
Copy Markdown
Contributor

⚠️ Jira Issue Key Missing

Your PR title doesn't contain a Jira issue key. Consider adding it for better traceability.

Example:

  • feat: add user authentication (CM-123)
  • feat: add user authentication (IN-123)

Projects:

  • CM: Community Data Platform
  • IN: Insights

Please add a Jira issue key to your PR title.

2 similar comments
@github-actions
Copy link
Copy Markdown
Contributor

⚠️ Jira Issue Key Missing

Your PR title doesn't contain a Jira issue key. Consider adding it for better traceability.

Example:

  • feat: add user authentication (CM-123)
  • feat: add user authentication (IN-123)

Projects:

  • CM: Community Data Platform
  • IN: Insights

Please add a Jira issue key to your PR title.

@github-actions
Copy link
Copy Markdown
Contributor

⚠️ Jira Issue Key Missing

Your PR title doesn't contain a Jira issue key. Consider adding it for better traceability.

Example:

  • feat: add user authentication (CM-123)
  • feat: add user authentication (IN-123)

Projects:

  • CM: Community Data Platform
  • IN: Insights

Please add a Jira issue key to your PR title.

@gaspergrom gaspergrom merged commit 593caea into main Jan 29, 2026
17 checks passed
@gaspergrom gaspergrom deleted the fix/mentions-sink branch January 29, 2026 15:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants