-
Notifications
You must be signed in to change notification settings - Fork 18
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
apply data types for dates #51
Conversation
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Hi @fivetran-reneeli! Looks mostly good.
A few comments:
- Can you regenerate docs?
- Can you update your issue with all the appropriate tags? [Bug] type mismatches using bigquery dbt_quickbooks#96
- We will probably want to update the integration test file updates in
dbt_quickbooks
in both the seed file and thedbt_project.yml
to match the updates indbt_quickbooks_source
and create a release there too. But I'd confirm with Joe just to make sure that is something we should do now or in a future sprint.
models/stg_quickbooks.yml
Outdated
@@ -223,7 +223,7 @@ models: | |||
description: Reference number for the transaction. | |||
- name: vendor_id | |||
description: Reference to the vendor the bill is linked with. | |||
- name: due_date_at | |||
- name: due_date |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Isn't this still due_date_at
?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Ah yes I switched it back to make it standard with the other models, but then realized it's called upon downstream so I meant to revert it to due_date_at
. Although, if we are making a PR in the transforms now, perhaps we should make it due_date
and make the appropriate changes downstream.
I actually was wondering why it was changed to due_date_at, since it just gets renamed to due_date in transforms where it gets called.
bill_link.due_date_at as due_date,
@fivetran-joemarkiewicz Any thoughts? I don't see the reason why it was renamed to due_date_at, in stg_quickbooks__bill
only
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This likely was just human error for why this one was named differently. Truthfully, I would be cautious if you are changing this as it will likely cause more scope creep than you think as you called out it is leveraged downstream. Additionally, if you change the name of this field it will be reflected as a breaking change in the source.
We can chat more about this during standup.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Added to the existing issue we now have for small fixes.
fivetran/dbt_quickbooks#101
Co-authored-by: Avinash Kunnath <108772760+fivetran-avinash@users.noreply.github.com>
Thanks @fivetran-avinash , made the updates and in transforms as well! This is ready for re-review as well as for tranforms |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
lgtm
@fivetran-reneeli LGTM |
PR Overview
This PR will address the following Issue/Feature: fivetran/dbt_quickbooks#96
This PR will result in the following new package version:
0.10.0
Moved to breaking, although these changes are under the hood and will not have visible impact on downstream model materializations, this will be breaking for users who still have the old timestamp version of the fields impacted.
This will also be in combo with PR #103 in the transforms-
Please detail what change(s) this PR introduces and any additional information that should be known during the review of this PR:
date
type (due_date
,transaction_date
). Previously, some fields were getting interpreted as timestamps while some were interpreted as dates, leading to errors downstream on joins.PR Checklist
Basic Validation
Please acknowledge that you have successfully performed the following commands locally:
Before marking this PR as "ready for review" the following have been applied:
Detailed Validation
Please acknowledge that the following validation checks have been performed prior to marking this PR as "ready for review":
Models should successfully run. Additionally will ask the customer to run on this branch as well.
Standard Updates
Please acknowledge that your PR contains the following standard updates:
dbt Docs
Please acknowledge that after the above were all completed the below were applied to your branch:
If you had to summarize this PR in an emoji, which would it be?
💃