Analytics Engineering Template

This template helps apply analytics engineering best practices when working with raw data on your local machine, such as financial statements downloaded as CSV. It can also be used for technical assessments when interviewing for data jobs.

Prerequisites

• Docker Desktop
• VS Code
• Dev Containers extension (Identifier: ms-vscode-remote.remote-containers)
• Create an environment variable LOCAL_DATA_PATH for the path to the folder containing the raw data you want to load, transform, and analyze. This folder will be mounted to the dev container.

Demo

1. Use this template to create a repository.
2. Clone your new repository.
3. Open the repository in VS Code.
4. Reopen in Container.
5. Open View > Terminal.
6. Run: make run

Original Inspiration

• Modern Data Stack in a Box
• nba-monte-carlo

Other Inspirations

• dbt-labs/jaffle-shop
• jwills/nba_monte_carlo
• l-mds/local-data-stack

Tools Used

• dbt-core
• dbt-duckdb
• dlt
• duckdb
• harlequin
• sqlfluff
• sqlfmt
• vscode-dbt-power-user