Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

1.7.0 Compat #499

Merged
merged 9 commits into from
Nov 9, 2023
Merged

1.7.0 Compat #499

merged 9 commits into from
Nov 9, 2023

Conversation

benc-db
Copy link
Collaborator

@benc-db benc-db commented Nov 8, 2023

Description

This PR includes
a.) change to get_catalog to account for changes that dbt made between 1.7.0rc1 and 1.7.0
b.) a fix for a PR I merged earlier that removed casts from seeding. Turns out that with hive and parquet, the cast is necessary for numeric types; the tests passed initially because the old version of the copy_into tests didn't use seeds, and nowhere else in our project do we test parquet and seeds.
c.) a modification to our external location integration variable because something has changed (I think in the dbr) so that its extra sensitive to running in the top level of a container

Checklist

  • I have run this code in development and it appears to resolve the stated issue
  • This PR includes tests, or tests are not required/relevant for this PR
  • I have updated the CHANGELOG.md and added information about my change to the "dbt-databricks next" section.

susodapop
susodapop previously approved these changes Nov 8, 2023
Copy link
Contributor

@susodapop susodapop left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Contributor

@mikealfare mikealfare left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I made some comments of a few things to discuss. I'll look through the full project, specifically for the Adapter and Relation classes, to see if I find anything else.

@@ -429,10 +429,20 @@ def parse_columns_from_information( # type: ignore[override]
return columns

def get_catalog(
self, manifest: Manifest, selected_nodes: Optional[Set] = None
self, manifest: Manifest, selected_nodes: Optional[Set[Any]] = None

This comment was marked as resolved.

This comment was marked as resolved.

dbt/adapters/databricks/impl.py Outdated Show resolved Hide resolved
dbt/adapters/databricks/impl.py Show resolved Hide resolved
@benc-db benc-db merged commit c5a4c45 into main Nov 9, 2023
21 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants