Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(service): improve migrations_check performance #2443

Merged
merged 44 commits into from Dec 1, 2021

Conversation

Panaetius
Copy link
Member

closes #2432

the git archive approach only works with git+ssh URLs, and we only get HTTPS in the service (Plus OAUTH2 doesn't work with SSH), so I opted for using the gitlab API to get the files.

@Panaetius Panaetius requested a review from a team as a code owner November 2, 2021 14:09
@Panaetius Panaetius changed the base branch from master to 2048-finegrained-migration-information November 2, 2021 14:10
@Panaetius Panaetius changed the title 2432 optimize check migrations feat(service): improve migrations_check performance Nov 2, 2021
Base automatically changed from 2048-finegrained-migration-information to master November 15, 2021 13:43
Panaetius and others added 3 commits November 15, 2021 16:03
* initial implementation of workflow loop
* Apply suggestions from code review
Co-authored-by: Ralf Grubenmann <ralf.grubenmann@sdsc.ethz.ch>
* rename loop to iterate subcommand
add option to specify mapping via command line for workflow iterate
* Apply suggestions from code review
Co-authored-by: Ralf Grubenmann <ralf.grubenmann@sdsc.ethz.ch>

Co-authored-by: Ralf Grubenmann <ralf.grubenmann@sdsc.ethz.ch>
* fix encoding format for output
* add encodingFormat node to shacl_shape for CommandOutput
m-alisafaee
m-alisafaee previously approved these changes Nov 24, 2021
renku/core/models/git.py Outdated Show resolved Hide resolved
renku/core/models/git.py Outdated Show resolved Hide resolved
renku/service/gateways/gitlab_api_provider.py Outdated Show resolved Hide resolved
renku/service/gateways/gitlab_api_provider.py Outdated Show resolved Hide resolved
renku/service/gateways/gitlab_api_provider.py Show resolved Hide resolved
@m-alisafaee m-alisafaee self-requested a review November 24, 2021 17:38
Copy link
Contributor

@m-alisafaee m-alisafaee left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sorry, I approved this by mistake and can't find how to dismiss it :|.

@Panaetius Panaetius enabled auto-merge (squash) November 26, 2021 08:06
@Panaetius Panaetius force-pushed the 2432-optimize-check-migrations branch from beba44a to fbcc54e Compare November 26, 2021 12:19
m-alisafaee
m-alisafaee previously approved these changes Dec 1, 2021
Copy link
Contributor

@m-alisafaee m-alisafaee left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you!

m-alisafaee
m-alisafaee previously approved these changes Dec 1, 2021
Copy link
Contributor

@m-alisafaee m-alisafaee left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚀

@Panaetius Panaetius merged commit 28dde77 into master Dec 1, 2021
@Panaetius Panaetius deleted the 2432-optimize-check-migrations branch December 1, 2021 23:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Optimize check_migrations endpoint to only clone what's necessary
4 participants