Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Capturing exposures data #14

Closed
kon-mal opened this issue Apr 12, 2021 · 3 comments
Closed

Capturing exposures data #14

kon-mal opened this issue Apr 12, 2021 · 3 comments

Comments

@kon-mal
Copy link
Contributor

kon-mal commented Apr 12, 2021

Thanks for creating this package - we have found it very useful in our dbt projects!

One thing we found missing was capturing information about exposures defined within our dbt projects. Especially, we were interested in exposing to our end users latest update times of different output models feeding the different exposures. We can extract the latest run of each model from the FCT_DBT__MODEL_EXECUTIONS model but exposures are not captured in any of the models.

Based on your work, we have created three models to capture this information and would be very keen to explore if you'd be interested in incorporating it into your package. Similar to your models capturing data on MODELS we built:

  • a staging model extracting metadata about exposures from manifest.json (STG_DBT__EXPOSURES),
  • a dimension model expanding exposure-model relations into separate row (DIM_DBT__EXPOSURES),
  • a fact model joining exposures and latest update times of each output model feeding them (FCT_DBT__EXPOSURES_UPDATES).

Let me know if that's something you'd be interested in!

@kgpayne
Copy link
Contributor

kgpayne commented Apr 15, 2021

Hey @kon-mal 👋 Thanks for raising this issue and for your work on exposures! Sounds very useful. Would you be willing to raise a PR with the additional models? I'd love to have a look, and do some testing too 👍

@kon-mal
Copy link
Contributor Author

kon-mal commented Apr 15, 2021

Thanks @kgpayne! I raised a PR with the models. Looking forward to your feedback!

@kgpayne
Copy link
Contributor

kgpayne commented Apr 16, 2021

Merged and included in Release 0.4.1 🚀 Thanks again @kon-mal 🙏

@kgpayne kgpayne closed this as completed Apr 16, 2021
NiallRees added a commit that referenced this issue Jul 21, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants