Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add an experimental dbt-sql template #1059

Merged
merged 29 commits into from
Feb 19, 2024

Conversation

lennartkats-db
Copy link
Contributor

@lennartkats-db lennartkats-db commented Dec 12, 2023

Changes

This adds a new dbt-sql template. This work requires the new WorkspaceFS support for dbt tasks.

In this latest revision, I've hidden the new template from the list so we can merge it, iterate over it, and propertly release the template at the right time.

Blockers:

Tests

  • Unit tests
  • Manual testing
  • More manual testing
  • Reviewer manual testing
    • I'd like to do a small bug bash post-merging.
  • Unit tests

@lennartkats-db lennartkats-db changed the title [WIP] Add a dbt template [WIP] Add a dbt-sql template Dec 12, 2023
@lennartkats-db lennartkats-db changed the title [WIP] Add a dbt-sql template [WIP] [DONTMERGE] Add a dbt-sql template Dec 23, 2023
github-merge-queue bot pushed a commit that referenced this pull request Dec 27, 2023
## Changes
This enhances the template selection experience a bit as we add more and
more built-in templates (like
#1051 and
#1059):

### New experience:
<img width="661" alt="image"
src="https://github.com/databricks/cli/assets/58432911/afe3b84d-8a77-47f3-b9c2-f827f7893cd7">

### Current experience:
<img width="265" alt="image"
src="https://github.com/databricks/cli/assets/58432911/36f8d568-819f-4920-83b1-fb76109ea3d1">

---------

Co-authored-by: shreyas-goenka <88374338+shreyas-goenka@users.noreply.github.com>
@lennartkats-db lennartkats-db marked this pull request as ready for review December 28, 2023 12:34
@lennartkats-db lennartkats-db changed the title [WIP] [DONTMERGE] Add a dbt-sql template [DONTMERGE] Add a dbt-sql template Dec 28, 2023
@codecov-commenter
Copy link

codecov-commenter commented Jan 27, 2024

Codecov Report

Attention: 12 lines in your changes are missing coverage. Please review.

Comparison is base (f70ec35) 52.53% compared to head (e5fb708) 52.51%.

Files Patch % Lines
libs/template/helpers.go 14.28% 11 Missing and 1 partial ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1059      +/-   ##
==========================================
- Coverage   52.53%   52.51%   -0.02%     
==========================================
  Files         308      308              
  Lines       17160    17175      +15     
==========================================
+ Hits         9015     9020       +5     
- Misses       7481     7489       +8     
- Partials      664      666       +2     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@lennartkats-db lennartkats-db changed the title [DONTMERGE] Add a dbt-sql template [DONTMERGE] [WIP] Add a dbt-sql template Jan 27, 2024
@lennartkats-db lennartkats-db changed the title [DONTMERGE] [WIP] Add a dbt-sql template Add a dbt-sql template Jan 28, 2024
@lennartkats-db lennartkats-db changed the title Add a dbt-sql template Add an experimental dbt-sql template Jan 29, 2024
libs/template/helpers.go Show resolved Hide resolved
},
"http_path": {
"type": "string",
"pattern": "^/sql/.\\../warehouses/[a-z0-9]+$",
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How does this pattern work without + or *?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not sure I understand this question. There is a + in there?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Or maybe you're referring to the \.\\.. part? That matches a version, like 1.0.

@lennartkats-db lennartkats-db removed the request for review from PaulCornellDB February 19, 2024 09:12
@lennartkats-db lennartkats-db added this pull request to the merge queue Feb 19, 2024
Merged via the queue into databricks:main with commit 1c68012 Feb 19, 2024
4 checks passed
@lennartkats-db lennartkats-db deleted the dbt-template branch February 19, 2024 09:20
andrewnester added a commit that referenced this pull request Feb 20, 2024
CLI:
 * Add support for UC Volumes to the `databricks fs` commands ([#1209](#1209)).

Bundles:
 * Use dynamic configuration model in bundles ([#1098](#1098)).
 * Allow use of variables references in primitive non-string fields ([#1219](#1219)).
 * Add an experimental default-sql template ([#1051](#1051)).
 * Add an experimental dbt-sql template ([#1059](#1059)).

Internal:
 * Add fork-user to winget release workflow ([#1214](#1214)).
 * Use `any` as type for data sources and resources in `tf/schema` ([#1216](#1216)).
 * Avoid infinite recursion when normalizing a recursive type ([#1213](#1213)).
 * Fix issue where interpolating a new ref would rewrite unrelated fields ([#1217](#1217)).
 * Use `dyn.Value` as input to generating Terraform JSON ([#1218](#1218)).

API Changes:
 * Changed `databricks lakehouse-monitors update` command with new required argument order.
 * Added `databricks online-tables` command group.

OpenAPI commit cdd76a98a4fca7008572b3a94427566dd286c63b (2024-02-19)
Dependency updates:
 * Bump Terraform provider to v1.36.2 ([#1215](#1215)).
 * Bump github.com/databricks/databricks-sdk-go from 0.32.0 to 0.33.0 ([#1222](#1222)).
@andrewnester andrewnester mentioned this pull request Feb 20, 2024
github-merge-queue bot pushed a commit that referenced this pull request Feb 20, 2024
CLI:
* Add support for UC Volumes to the `databricks fs` commands
([#1209](#1209)).

Bundles:
* Use dynamic configuration model in bundles
([#1098](#1098)).
* Allow use of variables references in primitive non-string fields
([#1219](#1219)).
* Add an experimental default-sql template
([#1051](#1051)).
* Add an experimental dbt-sql template
([#1059](#1059)).

Internal:
* Add fork-user to winget release workflow
([#1214](#1214)).
* Use `any` as type for data sources and resources in `tf/schema`
([#1216](#1216)).
* Avoid infinite recursion when normalizing a recursive type
([#1213](#1213)).
* Fix issue where interpolating a new ref would rewrite unrelated fields
([#1217](#1217)).
* Use `dyn.Value` as input to generating Terraform JSON
([#1218](#1218)).

API Changes:
* Changed `databricks lakehouse-monitors update` command with new
required argument order.
 * Added `databricks online-tables` command group.

OpenAPI commit cdd76a98a4fca7008572b3a94427566dd286c63b (2024-02-19)
Dependency updates:
* Bump Terraform provider to v1.36.2
([#1215](#1215)).
* Bump github.com/databricks/databricks-sdk-go from 0.32.0 to 0.33.0
([#1222](#1222)).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants