Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add replication to clouds #746

Merged
merged 6 commits into from
Nov 9, 2022
Merged

Add replication to clouds #746

merged 6 commits into from
Nov 9, 2022

Conversation

ravanelli
Copy link
Member

No description provided.

@ravanelli ravanelli force-pushed the replicate branch 2 times, most recently from 328d7bc to 513785e Compare November 8, 2022 14:36
Copy link
Member

@dustymabe dustymabe left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A few initial comments throughout the code.

libupload.groovy Show resolved Hide resolved
libupload.groovy Outdated Show resolved Hide resolved
libupload.groovy Outdated Show resolved Hide resolved
libupload.groovy Show resolved Hide resolved
libupload.groovy Outdated Show resolved Hide resolved
Comment on lines +73 to +65
if (c.regions) {
regions = c.regions.join(" ")
}
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I wonder if it's possible to autodetect here like we do for the other clouds?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm still waiting for a test secret to see how things go. =/. I will try as son as I got it.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let's not wait on the credentials for this. Let's leave this code in for now but also document it in docs/config.yaml. We can post any followup fixes/improvements that we find in the coming days.

I'd like to get this PR merged sooner than later so we can start really testing it out (in the FCOS pipeline).

@dustymabe
Copy link
Member

As part of this PR we probably need to do two other things:

  • replace the aws replication code in release.Jenkinsfile with a call to the new replicate function.
  • make the parameter to the different jobs for AWS_REPLICATION be something like CLOUD_REPLICATION now.

libcloud.groovy Outdated Show resolved Hide resolved
jobs/release.Jenkinsfile Show resolved Hide resolved
jobs/build-arch.Jenkinsfile Outdated Show resolved Hide resolved
jobs/build.Jenkinsfile Outdated Show resolved Hide resolved
jobs/release.Jenkinsfile Outdated Show resolved Hide resolved
libupload.groovy Outdated Show resolved Hide resolved
libupload.groovy Outdated Show resolved Hide resolved
libupload.groovy Show resolved Hide resolved
libcloud.groovy Outdated Show resolved Hide resolved
 - Add cloud replication for aws, aliyun and powervs in case
it is present in the meta.json

Signed-off-by: Renata Ravanelli <rravanel@redhat.com>
 - Add `--public` parameter for Aliyun cloud upload;
 - Update documentation to reflect the change.

Signed-off-by: Renata Ravanelli <rravanel@redhat.com>
 - Rename file for accuracy;
 - Update files using the old libupload call.

Signed-off-by: Renata Ravanelli <rravanel@redhat.com>
 - Rename parameter for accuracy;

Signed-off-by: Renata Ravanelli <rravanel@redhat.com>
 - Drop code and use replicate_to_clouds function instead.

Signed-off-by: Renata Ravanelli <rravanel@redhat.com>
Copy link
Member

@dustymabe dustymabe left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

mostly LGTM - a few final comments and then we should be able to push this I think.

Comment on lines +73 to +65
if (c.regions) {
regions = c.regions.join(" ")
}
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let's not wait on the credentials for this. Let's leave this code in for now but also document it in docs/config.yaml. We can post any followup fixes/improvements that we find in the coming days.

I'd like to get this PR merged sooner than later so we can start really testing it out (in the FCOS pipeline).

libupload.groovy Outdated
--bucket-prefix ${c.bucket} \
--regions ${regions} \
--credentials-file \${"POWER_IMAGE_UPLOAD_CONFIG"} \
--force
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we should probably remove the --force here and in the upload_to_clouds() function below. In the new pipeline structure we just allocate a new build ID typically.

 - Remove force option in libcloud;
 - Update documentation about powervs regions.

Signed-off-by: Renata Ravanelli <rravanel@redhat.com>
Copy link
Member

@dustymabe dustymabe left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@dustymabe dustymabe merged commit 28bb907 into coreos:main Nov 9, 2022
@ravanelli ravanelli deleted the replicate branch February 16, 2023 18:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants