-
Notifications
You must be signed in to change notification settings - Fork 124
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Address issues with sync optimization #2157
Conversation
WARNING!!! This PR is not attached to an issue. In most cases this is not advisable. Please see our PR docs for more information about how to attach this PR to an issue. |
1f4c104
to
1d6a521
Compare
b4b7ad9
to
8184030
Compare
I can't think of a situation when those scenarios are valid use cases. I agree that those are issues and the former is more severe, the latter is less critical, imo. |
9000e6d
to
e6ac88d
Compare
) | ||
except ClientResponseError as exc: | ||
if is_subrepo(directory) and exc.status == 404: | ||
log.warning("Unable to sync sub-repo '{}' from treeinfo.".format(directory)) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
How does i18n work, exactly? If it doesn't translate dynamic arguments then it would be safe to add it here.
result = get_repomd_file(remote, url) | ||
repomd_path = result.path | ||
repomd = cr.Repomd(repomd_path) | ||
repomd_checksum = get_sha256(repomd_path) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think either Ina or Tanya suggested doing this in the last PR, and combined with the refactoring it does let us ditch this code, which is great: https://github.com/pulp/pulp_rpm/pull/2157/files#diff-fb406f31027edc1c5b65abe7635bbd2830a7cc05c24a487344d7649017d14628L488-L494
@jlsherrill Heads up. Back during the meeting about mirrored metadata, we had discussed whether it should be possible for mirrored-metadata publications to be re-created even if the repositories themselves haven't changed, and no new repository version is created. And I think we agreed to do that for 7.0 / 7.1? (according to the document). We can actually do that for 3.16.1. Let me know if this would break Katello because we could back off on that change, but if it's beneficial and wouldn't break anything we can keep it. What happens if mirror=True in 3.14 and 3.15 is:
What happens in 3.16.1 if mirror=True / sync_policy=mirror_complete will be:
|
that all sounds good to me and should 'just work' with katello. I don't forsee any changes needed |
closes: #9535
https://pulp.plan.io/issues/9535