Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add gcs public bucket for prow staging logs. #1474

Closed
wants to merge 1 commit into from
Closed

Add gcs public bucket for prow staging logs. #1474

wants to merge 1 commit into from

Conversation

ameukam
Copy link
Member

@ameukam ameukam commented Dec 9, 2020

Following prow documentation guidance :
Create a gcs bucket for tide history and build logs.
Create a service account and grant admin access to the bucket.
Create a service account key and add the generated key to Secret Manager.

Signed-off-by: Arnaud Meukam ameukam@gmail.com

@k8s-ci-robot k8s-ci-robot added cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. size/M Denotes a PR that changes 30-99 lines, ignoring generated files. labels Dec 9, 2020
@ameukam
Copy link
Member Author

ameukam commented Dec 9, 2020

The service account key generated should be added as a secret in namespace prow.

@ameukam
Copy link
Member Author

ameukam commented Dec 9, 2020

/assign @BenTheElder @spiffxp

@ameukam
Copy link
Member Author

ameukam commented Dec 9, 2020

/hold

@k8s-ci-robot k8s-ci-robot added the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Dec 9, 2020
Following prow [documentation](https://github.com/kubernetes/test-infra/blob/master/prow/getting_started_deploy.md#configure-a-gcs-buckethttps://github.com/kubernetes/test-infra/blob/master/prow/getting_started_deploy.md#configure-a-gcs-bucket) guidance :
Create a GCS bucket for tide history and build logs.
Create a service account and grant admin access to the bucket.
Create a service account key and add the generated key to Secret
Manager.

Signed-off-by: Arnaud Meukam <ameukam@gmail.com>
@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: ameukam
To complete the pull request process, please assign spiffxp after the PR has been reviewed.
You can assign the PR to them by writing /assign @spiffxp in a comment when ready.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@ameukam ameukam mentioned this pull request Jan 6, 2021
9 tasks
Copy link
Member

@spiffxp spiffxp left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same comment as #1475 (comment) - I would like to better understand what the plan is

Comment on lines +60 to +63
# Buckets for the logs of prow
PROW_BUCKETS=(
k8s-prow-staging-logs
)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If the intent is to use this like gs://kubernetes-jenkins, I feel like we're going to want those sorts of buckets not in kubernetes-public. It'll be easier to keep track of CI artifact costs if they're in their own project. I'm open to suggestions.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The PR is more in favor of the support multiple buckets by tide. I didn't consider the billing aspect.

--project "${PROJECT}" \
--iam-account "${SERVICE_ACCOUNT_EMAIL}"

color 6 "Creating secret to store private key"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Who can access the secret? I would expect to see a gcloud secrets add-iam-policy-binding call

My suggestion would be k8s-infra-prow-oncall@ (I'm happy to approve a PR adding you as a member to that group)

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'll push the binding once the right option is chosen for gs://kubernetes-jenkins migration.

Base automatically changed from master to main February 9, 2021 00:35
@k8s-ci-robot
Copy link
Contributor

@ameukam: The following test failed, say /retest to rerun all failed tests:

Test name Commit Details Rerun command
pull-k8sio-yamllint 2e49fc0 link /test pull-k8sio-yamllint

Full PR test history. Your PR dashboard. Please help us cut down on flakes by linking to an open issue when you hit one in your PR.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@ameukam
Copy link
Member Author

ameukam commented Apr 8, 2021

/test pull-k8sio-yamllint

@k8s-ci-robot
Copy link
Contributor

@ameukam: The specified target(s) for /test were not found.
The following commands are available to trigger jobs:

  • /test pull-k8sio-cip
  • /test pull-k8sio-backup
  • /test pull-k8sio-groups-test
  • /test pull-k8sio-verify

Use /test all to run the following jobs:

  • pull-k8sio-verify

In response to this:

/test pull-k8sio-yamllint

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@ameukam
Copy link
Member Author

ameukam commented Apr 8, 2021

/test all

@ameukam
Copy link
Member Author

ameukam commented Apr 8, 2021

🤔 Force push on this branch doesn't update the PR. 2 things changed:

  • switch main as default branch
  • pull-k8sio-yamllint has been replaced by pull-k8s-verify.
    Will open a new PR tomorrow.

@ameukam
Copy link
Member Author

ameukam commented Apr 9, 2021

/close
For #1909

@k8s-ci-robot
Copy link
Contributor

@ameukam: Closed this PR.

In response to this:

/close
For #1909

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. size/M Denotes a PR that changes 30-99 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants