Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[dagster-dbt][fix] use standalone duckdb dbfile for row count test #21852

Merged
merged 3 commits into from
May 14, 2024

Conversation

benpankow
Copy link
Member

@benpankow benpankow commented May 14, 2024

Summary

Fix for flaky dagster-dbt test which uses a standalone duckdb file for the row count test, to control for duckdb holding the file lock.

Replaces #21763

Test Plan

bk

@benpankow
Copy link
Member Author

benpankow commented May 14, 2024

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @benpankow and the rest of your teammates on Graphite Graphite

@benpankow benpankow requested a review from rexledesma May 14, 2024 22:23
Copy link
Member

@rexledesma rexledesma left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

See comment, but 🙏

it, rather than using the default one-file-per-worker approach.
"""
jaffle_shop_duckdb_db_file_name = "cool_jaffle_shop"
jaffle_shop_duckdb_dbfile_path = f"target/{jaffle_shop_duckdb_db_file_name}.duckdb"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should probably parameterize this by the test name to guarantee isolations between tests

https://stackoverflow.com/a/34732269

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

had this initially but changed it to test something and forgot to change it back 😅 , thanks

@benpankow benpankow merged commit 2489802 into master May 14, 2024
1 check passed
@benpankow benpankow deleted the benpankow/duckdb-row-count-test branch May 14, 2024 23:24
alangenfeld pushed a commit that referenced this pull request May 15, 2024
…21852)

## Summary

Fix for flaky dagster-dbt test which uses a standalone duckdb file for
the row count test, to control for duckdb holding the file lock.

Replaces #21763 

## Test Plan

bk
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants