Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(core): make rerun work with new storage #2319

Merged
merged 2 commits into from Sep 15, 2021
Merged

Conversation

m-alisafaee
Copy link
Contributor

@m-alisafaee m-alisafaee commented Sep 8, 2021

Description

Reimplementation of the renku run <paths> using the new persistent layer. Support --from flag to start execution from a specific path. Returns 1 if no workflow is re-executed.
Followup story: #2323

Fixes #2258

@m-alisafaee m-alisafaee changed the base branch from master to 2257-new-renku-update September 9, 2021 10:41
@m-alisafaee m-alisafaee marked this pull request as ready for review September 10, 2021 10:30
@m-alisafaee m-alisafaee requested a review from a team as a code owner September 10, 2021 10:30
renku/core/commands/rerun.py Outdated Show resolved Hide resolved
def _get_activities(paths: List[str], sources: List[str], activity_gateway: IActivityGateway):
all_activities = defaultdict(set)

def include_newest_activity(activity):
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a duplicate of the one used in update, would make sense to unify them

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I've added a more general utility function and used it here. There is still a duplicated line but I believe it's more readable and re-usable this way.

@m-alisafaee m-alisafaee force-pushed the 2257-new-renku-update branch 7 times, most recently from 7279445 to f57ccb2 Compare September 13, 2021 16:27
@m-alisafaee m-alisafaee force-pushed the 2258-renku-rerun branch 2 times, most recently from b27701c to 2aa8abd Compare September 13, 2021 16:48
Panaetius
Panaetius previously approved these changes Sep 14, 2021
Copy link
Member

@Panaetius Panaetius left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you!

Base automatically changed from 2257-new-renku-update to master September 14, 2021 16:54
@m-alisafaee m-alisafaee merged commit c61a5ab into master Sep 15, 2021
@m-alisafaee m-alisafaee deleted the 2258-renku-rerun branch September 15, 2021 07:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

implement renku rerun with new database
2 participants