Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dagster: Fixes dag associations #1510

Merged
merged 3 commits into from
May 23, 2024
Merged

Conversation

ravenac95
Copy link
Member

@ravenac95 ravenac95 commented May 23, 2024

  • Update dag associations with production dbt
  • Adds all dbt targets as well

Closes #1483

Copy link

vercel bot commented May 23, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
kariba-network ✅ Ready (Inspect) Visit Preview 💬 Add feedback May 23, 2024 3:12pm
oso-docs ✅ Ready (Inspect) Visit Preview 💬 Add feedback May 23, 2024 3:12pm
oso-models ❌ Failed (Inspect) May 23, 2024 3:12pm
oso-www 🛑 Canceled (Inspect) May 23, 2024 3:12pm

@oso-prs
Copy link

oso-prs bot commented May 23, 2024

Test deployment for PR #1510 successfully deployed to oso-pull-requests.pr_1510.

@vercel vercel bot temporarily deployed to Preview – oso-models May 23, 2024 15:12 Inactive
@ravenac95 ravenac95 added this pull request to the merge queue May 23, 2024
Merged via the queue into main with commit 77a435a May 23, 2024
7 of 8 checks passed
@ravenac95 ravenac95 deleted the ravenac95/proper-dag-associations branch May 23, 2024 16:01
ccerv1 added a commit that referenced this pull request May 28, 2024
* Ensures factory deployers and deployers are separated (#1511)

* Dagster: Fixes dag associations (#1510)

* Update dag associations with production dbt

* Adds all dbt targets as well

* Dagster-Dbt: Fix handling of target paths (#1514)

Dagster: Fix handling of target paths

* minor fixes to mart models (#1509)

* add: artifact_source to artifacts_by_project_v1

* fix: hide rows with no metrics

* rf4: updates to eigentrust models

* rf4: updates to eigentrust models (#1515)

* feat: deploy docusaurus docs via GitHub Actions to Cloudflare (#1516)

* Testing the GitHub actions workflow instead of Vercel

* fix: install pnpm before node in deploy-docusaurus-docs (#1518)

* feat: deploy job for dbt generated docs (#1519)

* fix: use real BQ credentials in deploy-dbt-docs (#1520)

* fix: use the `indexer` environment for dbt docs deploy (#1523)

* fix: ignore workspace warning in deploy-dbt-docs (#1524)

* add: optimist sbt and refactor trust model (#1521)

* add optimist sbt and refactor trust model

* refactor: grab fid : address mappings direct from farcaster

* add: whether address is passport user or not

* fix: modify non-farcaster verifications

* fix: simplify user checks

* fix: artifact name to address

* fix: external-prs better error messages (#1527)

* Adds an .env.example so folks know how to configure this for local
  testing
* Reports in an error message what the valid commands are if you
  specified an invalid one
* Adds a bunch of comments in places

* add: deployer_v1 to API (#1525)

* add optimist sbt and refactor trust model

* refactor: grab fid : address mappings direct from farcaster

* add: whether address is passport user or not

* fix: modify non-farcaster verifications

* fix: simplify user checks

* feat: deployers_v1

* contracts model that includes deployments from factories

* add: artifact source field

* fix: union statement

* fix: roll back hasura (#1528)

* fix: roll back hasura

* set sync_to_db to false

* feat: pretty print results from external-prs (#1529)

* Add a summary message to ossd validation
* Separate messages by address/name
* Provide a way to share informational messages, not just errors
* Fix the status title for the GitHub app

* fix: update to actions/checkout@v4 (#1530)

* add: contracts model to hasura (#1531)

* add: contracts model to hasura

* add: contract query

* reduce contracts_v1 dimensions (#1532)

* reduce contracts_v1 dimensions

* make distinct

* fix: misaligned union

* filter null deployers from mart

* add: power user metric (#1534)

* add: power user metric

* chore: add metric to consolidate model

* fix: linting in new metric

* chore: update rf4 metrics blog post

* feat: additional rf4 repo eligibility checks (#1535)

* feat: additional rf4 repo eligibility checks

* chore: add repo checks to overall project checks

* fix: clean up todos

* fix: handling empty arrays

* feat: add ANY_EVM semantics to deployer crawling (#1540)

* Checks whether the oss-directory network is any_evm, includes if so
* Fix the join to join on both source and namespace

* fix: bump oss-directory 0.0.13 in external-prs (#1542)

* fix: removes artifact_type from artifacts, moves to a separate table (#1543)

* Previously, we were DISTINCT on source, namespace, name, AND type.
* This means that the same address was shown multiple times per
  artifact_type
* This refactor creates an intermediate model called int_all_artifacts
  that we can use
* artifact_type is removed from artifacts_v1 and artifacts_by_project_v1
* there's a new int_artifact_types table that we can use to get types

* fix: update to v4 of GitHub actions setup (#1544)

* fix: Hasura deploy needs Python (#1547)

---------

Co-authored-by: Reuven Gonzales <reuven@karibalabs.co>
Co-authored-by: Raymond Cheng <me@raymondcheng.net>
github-merge-queue bot pushed a commit that referenced this pull request May 28, 2024
* first pass at docs updates

* update figure to remove slug reference

* rebase to main (#1549)

* Ensures factory deployers and deployers are separated (#1511)

* Dagster: Fixes dag associations (#1510)

* Update dag associations with production dbt

* Adds all dbt targets as well

* Dagster-Dbt: Fix handling of target paths (#1514)

Dagster: Fix handling of target paths

* minor fixes to mart models (#1509)

* add: artifact_source to artifacts_by_project_v1

* fix: hide rows with no metrics

* rf4: updates to eigentrust models

* rf4: updates to eigentrust models (#1515)

* feat: deploy docusaurus docs via GitHub Actions to Cloudflare (#1516)

* Testing the GitHub actions workflow instead of Vercel

* fix: install pnpm before node in deploy-docusaurus-docs (#1518)

* feat: deploy job for dbt generated docs (#1519)

* fix: use real BQ credentials in deploy-dbt-docs (#1520)

* fix: use the `indexer` environment for dbt docs deploy (#1523)

* fix: ignore workspace warning in deploy-dbt-docs (#1524)

* add: optimist sbt and refactor trust model (#1521)

* add optimist sbt and refactor trust model

* refactor: grab fid : address mappings direct from farcaster

* add: whether address is passport user or not

* fix: modify non-farcaster verifications

* fix: simplify user checks

* fix: artifact name to address

* fix: external-prs better error messages (#1527)

* Adds an .env.example so folks know how to configure this for local
  testing
* Reports in an error message what the valid commands are if you
  specified an invalid one
* Adds a bunch of comments in places

* add: deployer_v1 to API (#1525)

* add optimist sbt and refactor trust model

* refactor: grab fid : address mappings direct from farcaster

* add: whether address is passport user or not

* fix: modify non-farcaster verifications

* fix: simplify user checks

* feat: deployers_v1

* contracts model that includes deployments from factories

* add: artifact source field

* fix: union statement

* fix: roll back hasura (#1528)

* fix: roll back hasura

* set sync_to_db to false

* feat: pretty print results from external-prs (#1529)

* Add a summary message to ossd validation
* Separate messages by address/name
* Provide a way to share informational messages, not just errors
* Fix the status title for the GitHub app

* fix: update to actions/checkout@v4 (#1530)

* add: contracts model to hasura (#1531)

* add: contracts model to hasura

* add: contract query

* reduce contracts_v1 dimensions (#1532)

* reduce contracts_v1 dimensions

* make distinct

* fix: misaligned union

* filter null deployers from mart

* add: power user metric (#1534)

* add: power user metric

* chore: add metric to consolidate model

* fix: linting in new metric

* chore: update rf4 metrics blog post

* feat: additional rf4 repo eligibility checks (#1535)

* feat: additional rf4 repo eligibility checks

* chore: add repo checks to overall project checks

* fix: clean up todos

* fix: handling empty arrays

* feat: add ANY_EVM semantics to deployer crawling (#1540)

* Checks whether the oss-directory network is any_evm, includes if so
* Fix the join to join on both source and namespace

* fix: bump oss-directory 0.0.13 in external-prs (#1542)

* fix: removes artifact_type from artifacts, moves to a separate table (#1543)

* Previously, we were DISTINCT on source, namespace, name, AND type.
* This means that the same address was shown multiple times per
  artifact_type
* This refactor creates an intermediate model called int_all_artifacts
  that we can use
* artifact_type is removed from artifacts_v1 and artifacts_by_project_v1
* there's a new int_artifact_types table that we can use to get types

* fix: update to v4 of GitHub actions setup (#1544)

* fix: Hasura deploy needs Python (#1547)

---------

Co-authored-by: Reuven Gonzales <reuven@karibalabs.co>
Co-authored-by: Raymond Cheng <me@raymondcheng.net>

* smol edits

* chore: update code/onchain metrics docs

* add: model links to other docs

---------

Co-authored-by: Reuven Gonzales <reuven@karibalabs.co>
Co-authored-by: Raymond Cheng <me@raymondcheng.net>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Clean up dependency associations with DBT and other data sources on dagster
1 participant