Skip to content

feat: added the status field to all project related datasource and pipes#3746

Merged
emlimlf merged 5 commits into
mainfrom
feat/project-archive-status
Jan 14, 2026
Merged

feat: added the status field to all project related datasource and pipes#3746
emlimlf merged 5 commits into
mainfrom
feat/project-archive-status

Conversation

@emlimlf
Copy link
Copy Markdown
Collaborator

@emlimlf emlimlf commented Jan 14, 2026

In this PR

  • Added the project status field from the segments table to the insights_projects_populated_ds.datasource and updated the copy pipe that fills data to that
  • Updated all the pipes and other data source that references the projects with the new status field

Ticket

IN-887


Note

Adds project status across Tinybird datasources and pipes for downstream consumers.

  • Extend insights_projects_populated_ds schema with status; populate via insights_projects_populated_copy.pipe (LEFT JOIN segments)
  • Update leaderboards_copy_ds schema and all leaderboards_* pipes to select/group/emit status
  • Include status in insightsProjects_filtered, collections_list featured projects, and search_collections_projects_repos outputs

Written by Cursor Bugbot for commit e654cfb. This will update automatically on new commits. Configure here.

Signed-off-by: Efren Lim <elim@linuxfoundation.org>
@emlimlf emlimlf requested review from epipav and gaspergrom January 14, 2026 07:19
Signed-off-by: Efren Lim <elim@linuxfoundation.org>
Signed-off-by: Efren Lim <elim@linuxfoundation.org>
@github-actions
Copy link
Copy Markdown
Contributor

⚠️ Jira Issue Key Missing

Your PR title doesn't contain a Jira issue key. Consider adding it for better traceability.

Example:

  • feat: add user authentication (CM-123)
  • feat: add user authentication (IN-123)

Projects:

  • CM: Community Data Platform
  • IN: Insights

Please add a Jira issue key to your PR title.

ON insights_projects_populated_copy_mentions.projectSlug = insightsProjects.slug
LEFT JOIN
segments
ON segments.id = insightsProjects.segmentId
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Missing FINAL on segments join inconsistent with file pattern

Medium Severity

The new LEFT JOIN segments lacks the FINAL keyword, inconsistent with all other ReplacingMergeTree table joins in this file (e.g., collectionsInsightsProjects FINAL, collections FINAL, integrations FINAL). The segments table uses ReplacingMergeTree with ENGINE_VER updatedAt. Without FINAL, unmerged updates could cause the join to return multiple rows per segment with different status values, producing duplicate project rows in the output.

Fix in Cursor Fix in Web

Signed-off-by: Efren Lim <elim@linuxfoundation.org>
@github-actions
Copy link
Copy Markdown
Contributor

⚠️ Jira Issue Key Missing

Your PR title doesn't contain a Jira issue key. Consider adding it for better traceability.

Example:

  • feat: add user authentication (CM-123)
  • feat: add user authentication (IN-123)

Projects:

  • CM: Community Data Platform
  • IN: Insights

Please add a Jira issue key to your PR title.

Signed-off-by: Efren Lim <elim@linuxfoundation.org>
@github-actions
Copy link
Copy Markdown
Contributor

⚠️ Jira Issue Key Missing

Your PR title doesn't contain a Jira issue key. Consider adding it for better traceability.

Example:

  • feat: add user authentication (CM-123)
  • feat: add user authentication (IN-123)

Projects:

  • CM: Community Data Platform
  • IN: Insights

Please add a Jira issue key to your PR title.

cast(coalesce(pp.memberActivityCount, 0) as Float64) as previousPeriodValue,
p.githubHandle as githubHandle
p.githubHandle as githubHandle,
'' as status
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Column order mismatch in members leaderboard UNION

High Severity

The status field is added after githubHandle in leaderboards_members.pipe, but all other leaderboard pipes add status before githubHandle is appended by leaderboards_copy.pipe. In a UNION ALL, column position determines alignment, not names. This causes githubHandle values from members to be written to the status column and vice versa when combined with other leaderboards. The status field needs to be placed before githubHandle to match the column order of other pipes.

Fix in Cursor Fix in Web

@emlimlf emlimlf merged commit b8f2d31 into main Jan 14, 2026
15 checks passed
@emlimlf emlimlf deleted the feat/project-archive-status branch January 14, 2026 08:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants