dbt-mssql

This is where to start the data transformation with dbt and SQL Server.

Sample data mart: covid

Start your local development with .\env\Scripts\activate. For more details: LOCALDEV.md

Common commands:

Set enviroment variables before any dbt operations as we're gonna use dbt env_var within our profiles.yml:

• Windows

set ENV_DBT_SERVER=DAT\DAT19
set ENV_DBT_PORT=1433
set ENV_DBT_DATABASE=PLAY
set ENV_DBT_SCHEMA=analytic
set ENV_DBT_USER=datnguye
set ENV_DBT_PASSWORD=datnguye

Seed data

Covid

dbt seed --project-dir ./dbt --target dev

Run all models

dbt run --project-dir ./dbt --target dev --full-refresh [--models +exposure:*]

Run all models - DELTA mode

dbt run --project-dir ./dbt --target dev [--models +exposure:*]

Test models

dbt test --project-dir ./dbt --target dev [--models +exposure:*]

Dockerizing

• Provisioning

• Processing

• API Service

Services

API service - Awesome dbt

An API endpoint using FastAPI with Prefect as a Dataflow

The dbt will be running as the background task, optional configured in queue.

Swagger:

Redoc:

See README.md for more details.

Admin portal

TBU

See README.md for more details.

WHAT next?

• Awesome dbt key vault / authentication / Serialize dbt Result
• The dbt with Postgres DB
• Admin portal