Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Copy images to AWS regions #533

Closed
jaypipes opened this issue Apr 4, 2022 · 6 comments
Closed

Copy images to AWS regions #533

jaypipes opened this issue Apr 4, 2022 · 6 comments
Assignees
Labels
area/release-eng Issues or PRs related to the Release Engineering subproject kind/feature Categorizes issue or PR as related to a new feature. sig/release Categorizes an issue or PR as relevant to SIG Release.

Comments

@jaypipes
Copy link

jaypipes commented Apr 4, 2022

image-promoter needs the ability to copy to AWS regions, based on a per-region bucket scheme.

Related: kubernetes/registry.k8s.io#39

@jaypipes coordinating with @Verolop and @puerco from Release Engineering

@jaypipes jaypipes added area/release-eng Issues or PRs related to the Release Engineering subproject kind/feature Categorizes issue or PR as related to a new feature. sig/release Categorizes an issue or PR as relevant to SIG Release. labels Apr 4, 2022
@jaypipes
Copy link
Author

/assign @jaypipes

@BenTheElder
Copy link
Member

xref: https://kubernetes.slack.com/archives/CCK68P2Q2/p1649978570481889?thread_ts=1649976555.356029&cid=CCK68P2Q2

So the layout is like $bucket/containers/image/sha256:$blobhash for all the blobs in GCS.

@ameukam has already run a sync between the GCS behind k8s.gcr.io and an s3 bucket.

If we can have the promoter promote digests in the manifest to paths like this in a bucket, then once that's enabled for a bucket we just need to run a backfill sync once, and we don't need any code for the backfill, it's just gsutil rsync gs://us.k8s-artifacts-prod s3://$bucket.

This is also pretty easy to redirect to in oci-proxy statelessly.

@k8s-triage-robot
Copy link

The Kubernetes project currently lacks enough contributors to adequately respond to all issues and PRs.

This bot triages issues and PRs according to the following rules:

  • After 90d of inactivity, lifecycle/stale is applied
  • After 30d of inactivity since lifecycle/stale was applied, lifecycle/rotten is applied
  • After 30d of inactivity since lifecycle/rotten was applied, the issue is closed

You can:

  • Mark this issue or PR as fresh with /remove-lifecycle stale
  • Mark this issue or PR as rotten with /lifecycle rotten
  • Close this issue or PR with /close
  • Offer to help out with Issue Triage

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle stale

@k8s-ci-robot k8s-ci-robot added the lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. label Jul 13, 2022
@riaankleinhans
Copy link

/remove-lifecycle stale

@BenTheElder should we keep this open to drive changes to the promotor to push to the S3 buckets or would the process of periodic syncing the bucket with GCS be sufficient?

@k8s-ci-robot k8s-ci-robot removed the lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. label Jul 20, 2022
@riaankleinhans
Copy link

Resolved by kubernetes/k8s.io#4118
/close

@k8s-ci-robot
Copy link
Contributor

@Riaankl: Closing this issue.

In response to this:

Resolved by kubernetes/k8s.io#4118
/close

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

Repository owner moved this from Breakdown TODO to Breakdown Done in registry.k8s.io (SIG K8S Infra) Sep 15, 2022
@riaankleinhans riaankleinhans moved this from Breakdown Done to Validation Done in registry.k8s.io (SIG K8S Infra) Sep 15, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/release-eng Issues or PRs related to the Release Engineering subproject kind/feature Categorizes issue or PR as related to a new feature. sig/release Categorizes an issue or PR as relevant to SIG Release.
Projects
None yet
Development

No branches or pull requests

5 participants