Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Load all code artifacts on grpc server startup, not just pipelines/jobs #8040

Merged
merged 1 commit into from May 24, 2022

Conversation

gibsondan
Copy link
Member

Summary:
User reported a race condition with partition set loading - we have logic in place to prevent this for jobs/pipelines, but not for the other code artifacts. Fix that by adding a new method that pulls in any lazy code artifacts at grpc server startup time.

Test Plan:
Add log outputs to validate that partition sets are loaded as soon as the grpc server is started up

Summary & Motivation

How I Tested These Changes

@vercel
Copy link

vercel bot commented May 24, 2022

The latest updates on your projects. Learn more about Vercel for Git ↗︎

2 Ignored Deployments
Name Status Preview Updated
dagit-storybook ⬜️ Ignored (Inspect) May 24, 2022 at 7:36PM (UTC)
dagster ⬜️ Ignored (Inspect) May 24, 2022 at 7:36PM (UTC)

Summary:
User reported a race condition with partition set loading - we have logic in place to prevent this for jobs/pipelines, but not for the other code artifacts. Fix that by adding a new method that pulls in any lazy code artifacts at grpc server startup time.

Test Plan:
Add log outputs to validate that partition sets are loaded as soon as the grpc server is started up
@gibsondan gibsondan merged commit 9d98be1 into master May 24, 2022
@gibsondan gibsondan deleted the racecond branch May 24, 2022 20:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants