Skip to content

Bulk Cube Deployment #1558

Merged
shangyian merged 9 commits intoDataJunction:mainfrom
shangyian:cube-deployment
Nov 5, 2025
Merged

Bulk Cube Deployment #1558
shangyian merged 9 commits intoDataJunction:mainfrom
shangyian:cube-deployment

Conversation

@shangyian
Copy link
Copy Markdown
Collaborator

@shangyian shangyian commented Nov 4, 2025

Summary

This change results in faster deployments for multiple cubes, and also prevents partial deployments via atomic commits.

The cube deployment flow is refactored here to use an atomic transaction-based approach instead of individual deployments per cube. This means that cubes now deploy through the same flow as other node types in a single DB transaction - they either all succeed or all fail together.

This change also sets up bulk validation for cubes, where we batch load all metrics/dimensions across cubes at once and then validate per-cube to provide cube-level feedback on failing configs.

Test Plan

  • PR has an associated issue: #
  • make check passes
  • make test shows 100% unit test coverage

Deployment Plan

@netlify
Copy link
Copy Markdown

netlify bot commented Nov 4, 2025

Deploy Preview for thriving-cassata-78ae72 canceled.

Name Link
🔨 Latest commit 6d970f8
🔍 Latest deploy log https://app.netlify.com/projects/thriving-cassata-78ae72/deploys/690a3fce601b8d0008975bd6

@shangyian shangyian changed the title Cube deployment Cube Deployment to Single Transaction Nov 5, 2025
@shangyian shangyian marked this pull request as ready for review November 5, 2025 01:27
@shangyian shangyian changed the title Cube Deployment to Single Transaction Bulk Cube Deployment Nov 5, 2025
@shangyian shangyian merged commit e48f09a into DataJunction:main Nov 5, 2025
17 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant