Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Setup a k8s-infra prow instance #1394

Closed
8 of 9 tasks
ameukam opened this issue Nov 4, 2020 · 19 comments
Closed
8 of 9 tasks

Setup a k8s-infra prow instance #1394

ameukam opened this issue Nov 4, 2020 · 19 comments
Assignees
@spiffxp @BenTheElder
Labels
area/apps/prow k8s-infra-prow.k8s.io, code in apps/prow/ area/infra Infrastructure management, infrastructure design, code in infra/ area/prow Setting up or working with prow in general, prow.k8s.io, prow build clusters lifecycle/frozen Indicates that an issue or PR should not be auto-closed due to staleness. priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release. sig/k8s-infra Categorizes an issue or PR as relevant to SIG K8s Infra. sig/testing Categorizes an issue or PR as relevant to SIG Testing.
Projects
sig-k8s-infra

Comments

@ameukam
Copy link
Member

ameukam commented Nov 4, 2020 •
edited

Part of #752

Why it's needed :

The current prow instance https://prow.k8s.io should be moved to the community-owned infrastructure.
The prow staging instance k8s-infra-prow will help identify the resources needed and define a migration plan.

What's needed (not in a specific order):

Other considerations:
@ameukam
Copy link
Member Author

ameukam commented Nov 4, 2020

/wg k8s-infra
/sig testing
/area cluster-infra
/assign @spiffxp @BenTheElder

@k8s-ci-robot k8s-ci-robot added sig/testing Categorizes an issue or PR as relevant to SIG Testing. area/infra Infrastructure management, infrastructure design, code in infra/ labels Nov 4, 2020
This was referenced Nov 10, 2020
Merged
Merged
This was referenced Dec 9, 2020
Merged
Closed
@ameukam ameukam mentioned this issue Jan 20, 2021
Closed
@spiffxp spiffxp added this to Blocked in sig-k8s-infra Jan 20, 2021
@spiffxp spiffxp added the priority/important-longterm Important over the long term, but may not be staffed and/or may need multiple releases to complete. label Jan 22, 2021
@spiffxp spiffxp mentioned this issue Jan 22, 2021
Open
@ameukam ameukam mentioned this issue Mar 17, 2021
Closed
ameukam added a commit to ameukam/k8s.io that referenced this issue Mar 25, 2021
@ameukam
Deploy ghproxy
73e13bd 
Triage-Party sometimes hit the Github API Limit.
```
message: "oh snap! I reached the GitHub search API limit: GET https://api.github.com/repos/kubernetes/release/issues?per_page=100&since=2021-02-23T15%3A13%3A29Z&state=closed: 403 API rate limit of 5000 still exceeded until 2021-03-25 15:17:12 +0000 UTC, not making remote request. [rate reset in 3m42s]"
```
GH Proxy can be used to cache TP API calls.

Ultimately, ghproxy needs to be deploy as part of
kubernetes#1394.

Signed-off-by: Arnaud Meukam <ameukam@gmail.com>
ameukam added a commit to ameukam/k8s.io that referenced this issue Mar 25, 2021
@ameukam
Deploy ghproxy
447fc66 
Triage-Party sometimes hit the Github API Limit.
```
message: "oh snap! I reached the GitHub search API limit: GET https://api.github.com/repos/kubernetes/release/issues?per_page=100&since=2021-02-23T15%3A13%3A29Z&state=closed: 403 API rate limit of 5000 still exceeded until 2021-03-25 15:17:12 +0000 UTC, not making remote request. [rate reset in 3m42s]"
```
GH Proxy can be used to cache TP API calls.

Ultimately, ghproxy needs to be deploy as part of
kubernetes#1394.

Signed-off-by: Arnaud Meukam <ameukam@gmail.com>
ameukam added a commit to ameukam/k8s.io that referenced this issue Mar 25, 2021
@ameukam
Deploy ghproxy
25541f8 
Triage-Party sometimes hit the Github API Limit.
```
message: "oh snap! I reached the GitHub search API limit: GET https://api.github.com/repos/kubernetes/release/issues?per_page=100&since=2021-02-23T15%3A13%3A29Z&state=closed: 403 API rate limit of 5000 still exceeded until 2021-03-25 15:17:12 +0000 UTC, not making remote request. [rate reset in 3m42s]"
```
GH Proxy can be used to cache TP API calls.

Ultimately, ghproxy needs to be deploy as part of
kubernetes#1394.

Signed-off-by: Arnaud Meukam <ameukam@gmail.com>
@ameukam ameukam mentioned this issue Mar 25, 2021
Merged
@ameukam
Copy link
Member Author

ameukam commented Mar 31, 2021

As discussed during WG K8s infra meeting of March 31 2021, we agreed to call k8s-infra-prow.
Impact on (maybe):
DNS : prow-staging.k8s.io -> k8s-infra-prow.k8s.io
Namespace used in the build cluster ?

ameukam added a commit to ameukam/k8s.io that referenced this issue Mar 31, 2021
@ameukam
Add github admins for k8s-staging-ci-robot
17a355d 
For kubernetes#1394, we will need
a new github account acting as a new bot
[k8s-staging-ci-robot](https://github.com/k8s-staging-ci-robot). Adding
a new mailing list that list be use for administration of this robot.

Signed-off-by: Arnaud Meukam <ameukam@gmail.com>
@ameukam ameukam mentioned this issue Mar 31, 2021
Merged
@spiffxp
Copy link
Member

spiffxp commented Mar 31, 2021

/retitle
Setup a k8s-infra prow instance

@k8s-ci-robot k8s-ci-robot changed the title Setup a prow staging instance Setup a k8s-infra prow instance Mar 31, 2021
ameukam added a commit to ameukam/k8s.io that referenced this issue Apr 1, 2021
@ameukam
Add github admins for k8s-staging-ci-robot
5190f76 
For kubernetes#1394, we will need
a new github account acting as a new bot
[k8s-staging-ci-robot](https://github.com/k8s-staging-ci-robot). Adding
a new mailing list that list be use for administration of this robot.

Signed-off-by: Arnaud Meukam <ameukam@gmail.com>
@ameukam
Copy link
Member Author

ameukam commented Apr 16, 2021

/milestone v1.22

@k8s-ci-robot k8s-ci-robot added this to the v1.22 milestone Apr 16, 2021
@spiffxp
Copy link
Member

spiffxp commented Jun 9, 2021

I'm not entirely clear on why this is in Blocked other than I think we need to get a plan of agreed-upon next steps

The latest outstanding PR I see related to this is #1909 but it's in need of a rebase and I'm not sure whether my review comments were addressed

@ameukam
Copy link
Member Author

ameukam commented Jun 9, 2021

The latest outstanding PR I see related to this is #1909 but it's in need of a rebase and I'm not sure whether my review comments were addressed

@spiffxp I need to cleanup and rebase #1909. The only change is a added commit with a Terraform version of the PR : 03d55ef.

@spiffxp
Copy link
Member

spiffxp commented Jun 9, 2021

(from slack) We need to sign the CLA for https://github.com/k8s-infra-ci-robot and make it an owner of the appropriate kubernetes orgs

@ameukam ameukam mentioned this issue Aug 10, 2021
Closed
@ameukam
Copy link
Member Author

ameukam commented Aug 11, 2021

We now have a instance running: https://k8s-infra-prow.k8s.io

@ameukam
Copy link
Member Author

ameukam commented Aug 11, 2021

https://k8s-infra-prow.k8s.io/pr is functional

This was referenced Aug 12, 2021
Merged
Merged
Merged
This was referenced Aug 16, 2021
Closed
Merged
@spiffxp
Copy link
Member

spiffxp commented Sep 15, 2021

/remove-priority important-longterm
/priority important-soon

@k8s-ci-robot k8s-ci-robot added priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release. and removed priority/important-longterm Important over the long term, but may not be staffed and/or may need multiple releases to complete. labels Sep 15, 2021
This was referenced Sep 23, 2021
Merged
Merged
@spiffxp
Copy link
Member

spiffxp commented Sep 24, 2021

AIUI an incorrect kubeconfig was preventing us from scheduling jobs on the k8s-infra-prow-build cluster, which has since been updated.

https://k8s-infra-prow.k8s.io/ now shows a heartbeat job being regularly scheduled

@k8s-ci-robot k8s-ci-robot added sig/k8s-infra Categorizes an issue or PR as relevant to SIG K8s Infra. and removed wg/k8s-infra labels Sep 29, 2021
ameukam added a commit to ameukam/k8s.io that referenced this issue Oct 8, 2021
@ameukam
k8s-infra-prow: Add testgrid annotations
144fd4a 
Ref: kubernetes#1394

List the job in sig-k8s-infra testgrid dashboard.

Signed-off-by: Arnaud Meukam <ameukam@gmail.com>
@ameukam ameukam mentioned this issue Oct 8, 2021
Merged
ameukam added a commit to ameukam/k8s.io that referenced this issue Oct 8, 2021
@ameukam
k8s-infra-prow: Ingress for IpV6
96f1853 
Ref: kubernetes#1394
Expose k8s-infra-prow.k8s.io using IPv6.

Signed-off-by: Arnaud Meukam <ameukam@gmail.com>
@ameukam ameukam mentioned this issue Oct 8, 2021
Merged
ameukam added a commit to ameukam/k8s.io that referenced this issue Nov 5, 2021
@ameukam
aaa: Enable GKE workloads metrics
26f613e 
Related:
  - part of: kubernetes#1394

Enable GKE workloads metrics that give the capability to send metrics
for a GKE cluster to cloud monitoring.
See: https://cloud.google.com/stackdriver/docs/solutions/gke/managing-metrics#enable-workload-metrics

Signed-off-by: Arnaud Meukam <ameukam@gmail.com>
@ameukam ameukam mentioned this issue Nov 5, 2021
Merged
@ameukam
Copy link
Member Author

ameukam commented Dec 14, 2021

/milestone clear
/lifecycle frozen

@k8s-ci-robot k8s-ci-robot added the lifecycle/frozen Indicates that an issue or PR should not be auto-closed due to staleness. label Dec 14, 2021
@k8s-ci-robot k8s-ci-robot removed this from the v1.23 milestone Dec 14, 2021
@ameukam
Copy link
Member Author

ameukam commented Feb 2, 2024

This are done with this experiment at the moment.
We intent rebuild a separate infrastructure during the migration of prow.k8s.io
/close

@k8s-ci-robot
Copy link
Contributor

@ameukam: Closing this issue.

In response to this:

This are done with this experiment at the moment.
We intent rebuild a separate infrastructure during the migration of prow.k8s.io
/close

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

sig-k8s-infra automation moved this from Blocked to Done Feb 2, 2024
@ameukam ameukam mentioned this issue Feb 2, 2024
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@spiffxp spiffxp

@BenTheElder BenTheElder

Labels
area/apps/prow k8s-infra-prow.k8s.io, code in apps/prow/ area/infra Infrastructure management, infrastructure design, code in infra/ area/prow Setting up or working with prow in general, prow.k8s.io, prow build clusters lifecycle/frozen Indicates that an issue or PR should not be auto-closed due to staleness. priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release. sig/k8s-infra Categorizes an issue or PR as relevant to SIG K8s Infra. sig/testing Categorizes an issue or PR as relevant to SIG Testing.
Projects
sig-k8s-infra
  
Done
Milestone
No milestone
Development

No branches or pull requests
4 participants
@spiffxp @BenTheElder @ameukam @k8s-ci-robot