Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

switch catalog discovery and syncs to temporal #2333

Merged
merged 7 commits into from
Mar 5, 2021

Conversation

jrhizor
Copy link
Contributor

@jrhizor jrhizor commented Mar 5, 2021

add discovery + syncs + very minor refactors

@jrhizor jrhizor requested a review from cgardens March 5, 2021 17:56
@jrhizor jrhizor changed the title switch catalog discovery to temporal switch catalog discovery and syncs to temporal Mar 5, 2021
Copy link
Contributor

@cgardens cgardens left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks good! one comment otherwise g2g.

@@ -112,4 +115,18 @@ public static StandardTargetConfig syncToTargetConfig(StandardSyncInput sync) {
.withState(sync.getState());
}

// todo (cgardens) - there are 2 sources of truth for job path. we need to reduce this down to one,
// once we are fully on temporal.
public static Path getJobRoot(Path workspaceRoot, IntegrationLauncherConfig launcherConfig) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

good call. I think you can replace the code in WorkerRun on line 52 with this too. gives us a better chance of making sure we get the paths right in temporal and outside of it.

@jrhizor
Copy link
Contributor Author

jrhizor commented Mar 5, 2021

This is working end to end locally in my testing. Need to fix the build + one comment and this should be ready to merge.

@jrhizor jrhizor merged commit c3d0442 into master Mar 5, 2021
@jrhizor jrhizor deleted the jrhizor/discover-worker branch March 5, 2021 19:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants