Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bigquery sync partitioned fields #36892

Merged
merged 55 commits into from
Dec 25, 2023
Merged

Bigquery sync partitioned fields #36892

merged 55 commits into from
Dec 25, 2023

Conversation

qnkhuat
Copy link
Contributor

@qnkhuat qnkhuat commented Dec 18, 2023

Milestone 2 of #36668

This will sync whether a field is a partition field.

There is a special case for ingestion time partition because it'll be partitioned on a pseudo-column _PARTITIONTIME or _PARTITIONDATE. So to support the milestone 3, where we need to make our sync adds a filter for tables that require a filter, I've changed the code so that these 2 pseudo-columns are added manually.

@metabase-bot metabase-bot bot added the .Team/BackendComponents also known as BEC label Dec 18, 2023
Copy link

cypress bot commented Dec 18, 2023

1 failed and 3 flaky tests on run #1041 ↗︎

1 2197 155 2 Flakiness 3
⚠️ You've recorded test results over your free plan limit.
Upgrade your plan to view test results.

Details:

Bigquery sync partitioned fields
Project: Metabase e2e Commit: e5e0cab2d3
Status: Failed Duration: 16:19 💡
Started: Dec 25, 2023 3:49 AM Ended: Dec 25, 2023 4:05 AM

Review all test suite changes for PR #36892 ↗︎

Base automatically changed from ngoc-bigquery-sync-filter-key to master December 20, 2023 09:40
Copy link
Contributor

@calherries calherries left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, I'm approving conditional on _PARTITIONDATE not being required

@qnkhuat qnkhuat added the no-backport Do not backport this PR to any branch label Dec 22, 2023
@qnkhuat qnkhuat merged commit d3dabc6 into master Dec 25, 2023
101 of 102 checks passed
@qnkhuat qnkhuat deleted the ngoc-sync-partition-key branch December 25, 2023 04:10
Copy link

@qnkhuat Did you forget to add a milestone to the issue for this PR? When and where should I add a milestone?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
no-backport Do not backport this PR to any branch .Team/BackendComponents also known as BEC
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants