May 2023 #9

vadasambar · 2023-05-02T05:16:27Z

Last month's thread:
Apr 2023: #8

What

This is an issue to update daily status on what I am doing as a member of vadafoss community.

How

Follow this format

## <3-letter-month> <2-letter-day> <4-letter-year>
### やったこと
### Problem
### Try
### TODO
### WIP

やったこと: yatta-koto lit. 'things I did' in Japanese (I just find it sounds closer to what I want to say)
Problem (optional): problems I faced
Try (optional): what I am trying
TODO (optional): things to do
WIP (optional): work in progress

The text was updated successfully, but these errors were encountered:

vadasambar · 2023-05-02T05:16:41Z

May 02 2023

やったこと

come up with a way to test feat: support custom scheduler config (without extenders) kubernetes/autoscaler#5708
- tested with scheduler extender: feat: support custom scheduler config (without extenders) kubernetes/autoscaler#5708 (comment)

WIP

planning
come up with a way to test feat: support custom scheduler config (without extenders) kubernetes/autoscaler#5708
- redact sensitive info and post the results of expander test as a comment

TODO

come up with a way to test feat: support custom scheduler config (without extenders) kubernetes/autoscaler#5708
- test with custom config for in-tree plugins
check if validating the config is really required for feat: support custom scheduler config (without extenders) kubernetes/autoscaler#5708
look at the behavior of scheduler when it fails to reach extender and replicate it in feat: support custom scheduler config (without extenders) kubernetes/autoscaler#5708
apply for Kubernetes community membership: https://github.com/kubernetes/community/blob/master/community-membership.md
- brought it up in the sig-autoscaling meeting. Waiting for the community's response
- https://docs.google.com/document/d/1RvhQAEIrVLHbyNnuaT99-6u9ZUMp7BfkPupT2LAZK7w/edit#
respond to new comment in Cluster autoscaler ignore node taints? kubernetes/autoscaler#4231
Cluster autoscaler ignore node taints? kubernetes/autoscaler#4231
- go through the code to understand what might be happening
check Add info about mirror pods in FAQ kubernetes/autoscaler#5566 (comment)
check comment support overprovsioning without pending pods kubernetes/autoscaler#5377 (comment)
check the Kanban

Problem

check the Kanban

vadasambar · 2023-05-03T04:33:24Z

May 03 2023

やったこと

come up with a way to test feat: support custom scheduler config (without extenders) kubernetes/autoscaler#5708
- redact sensitive info and post the results of expander test as a comment
  - done: feat: support custom scheduler config (without extenders) kubernetes/autoscaler#5708 (comment)

WIP

planning

TODO

come up with a way to test feat: support custom scheduler config (without extenders) kubernetes/autoscaler#5708
- test with custom config for in-tree plugins
check if validating the config is really required for feat: support custom scheduler config (without extenders) kubernetes/autoscaler#5708
look at the behavior of scheduler when it fails to reach extender and replicate it in feat: support custom scheduler config (without extenders) kubernetes/autoscaler#5708
apply for Kubernetes community membership: https://github.com/kubernetes/community/blob/master/community-membership.md
- brought it up in the sig-autoscaling meeting. Waiting for the community's response
- https://docs.google.com/document/d/1RvhQAEIrVLHbyNnuaT99-6u9ZUMp7BfkPupT2LAZK7w/edit#
respond to new comment in Cluster autoscaler ignore node taints? kubernetes/autoscaler#4231
Cluster autoscaler ignore node taints? kubernetes/autoscaler#4231
- go through the code to understand what might be happening
check Add info about mirror pods in FAQ kubernetes/autoscaler#5566 (comment)
check comment support overprovsioning without pending pods kubernetes/autoscaler#5377 (comment)
check the Kanban

Problem

check the Kanban

vadasambar · 2023-05-04T04:13:55Z

May 04 2023

やったこと

WIP

planning

TODO

check out new comments in Cluster Autoscaler resets unneeded since time to 0s kubernetes/autoscaler#5618
come up with a way to test feat: support custom scheduler config (without extenders) kubernetes/autoscaler#5708
- test with custom config for in-tree plugins
check if validating the config is really required for feat: support custom scheduler config (without extenders) kubernetes/autoscaler#5708
look at the behavior of scheduler when it fails to reach extender and replicate it in feat: support custom scheduler config (without extenders) kubernetes/autoscaler#5708
apply for Kubernetes community membership: https://github.com/kubernetes/community/blob/master/community-membership.md
- brought it up in the sig-autoscaling meeting. Waiting for the community's response
- https://docs.google.com/document/d/1RvhQAEIrVLHbyNnuaT99-6u9ZUMp7BfkPupT2LAZK7w/edit#
respond to new comment in Cluster autoscaler ignore node taints? kubernetes/autoscaler#4231
Cluster autoscaler ignore node taints? kubernetes/autoscaler#4231
- go through the code to understand what might be happening
check Add info about mirror pods in FAQ kubernetes/autoscaler#5566 (comment)
check comment support overprovsioning without pending pods kubernetes/autoscaler#5377 (comment)
check the Kanban

Problem

check the Kanban

vadasambar · 2023-05-05T04:34:36Z

May 05 2023

やったこと

start a draft PR to fix Should --scale-down-delay-after-add be per-nodepool? kubernetes/autoscaler#3071
- feat: support --scale-down-delay-after-* per nodegroup kubernetes/autoscaler#5729
tweeted about AUTOSCALER_ENV_VARS support for GCE provider in cluster-autoscaler: https://twitter.com/_vadasambar/status/1654369700737077249
created an issue to add README for gce provider in cluster-autoscaler: Create documentation for GCE provider in cluster-autoscaler kubernetes/autoscaler#5730

WIP

planning

TODO

check out new comments in Cluster Autoscaler resets unneeded since time to 0s kubernetes/autoscaler#5618
[DEADLINE: 8th May before SIG meeting] come up with a way to test feat: support custom scheduler config (without extenders) kubernetes/autoscaler#5708
- test with custom config for in-tree plugins
- add a comment in the PR
check if validating the config is really required for feat: support custom scheduler config (without extenders) kubernetes/autoscaler#5708
look at the behavior of scheduler when it fails to reach extender and replicate it in feat: support custom scheduler config (without extenders) kubernetes/autoscaler#5708
apply for Kubernetes community membership: https://github.com/kubernetes/community/blob/master/community-membership.md
- brought it up in the sig-autoscaling meeting. Waiting for the community's response
- https://docs.google.com/document/d/1RvhQAEIrVLHbyNnuaT99-6u9ZUMp7BfkPupT2LAZK7w/edit#
respond to new comment in Cluster autoscaler ignore node taints? kubernetes/autoscaler#4231
Cluster autoscaler ignore node taints? kubernetes/autoscaler#4231
- go through the code to understand what might be happening
check Add info about mirror pods in FAQ kubernetes/autoscaler#5566 (comment)
check comment support overprovsioning without pending pods kubernetes/autoscaler#5377 (comment)
check the Kanban

Problem

check the Kanban

vadasambar · 2023-05-08T04:16:17Z

May 08 2023

やったこと

check out review comments for feat: support custom scheduler config (without extenders) kubernetes/autoscaler#5708
- replied to the comments
check out review comments for feat: support --scale-down-delay-after-* per nodegroup kubernetes/autoscaler#5729
- replied to the comments
address review comments for feat: support --scale-down-delay-after-* per nodegroup kubernetes/autoscaler#5729
- addressed most of them
- added code to update scale up time per nodegroup
- moved struct to track scale up times to clusterstate
- code: kubernetes/autoscaler@e90529b

WIP

TODO

create issue for becoming member of Kubernetes org
address review comments for feat: support --scale-down-delay-after-* per nodegroup kubernetes/autoscaler#5729
get an OK for proceeding ahead on feat: support custom scheduler config (without extenders) kubernetes/autoscaler#5708 from the community
address review comments for feat: support custom scheduler config (without extenders) kubernetes/autoscaler#5708
check out new comments in Cluster Autoscaler resets unneeded since time to 0s kubernetes/autoscaler#5618
come up with a way to test feat: support custom scheduler config (without extenders) kubernetes/autoscaler#5708
- test with custom config for in-tree plugins
- add a comment in the PR
check if validating the config is really required for feat: support custom scheduler config (without extenders) kubernetes/autoscaler#5708
look at the behavior of scheduler when it fails to reach extender and replicate it in feat: support custom scheduler config (without extenders) kubernetes/autoscaler#5708
apply for Kubernetes community membership: https://github.com/kubernetes/community/blob/master/community-membership.md
- brought it up in the sig-autoscaling meeting. Waiting for the community's response
- https://docs.google.com/document/d/1RvhQAEIrVLHbyNnuaT99-6u9ZUMp7BfkPupT2LAZK7w/edit#
respond to new comment in Cluster autoscaler ignore node taints? kubernetes/autoscaler#4231
Cluster autoscaler ignore node taints? kubernetes/autoscaler#4231
- go through the code to understand what might be happening
check Add info about mirror pods in FAQ kubernetes/autoscaler#5566 (comment)
check comment support overprovsioning without pending pods kubernetes/autoscaler#5377 (comment)
check the Kanban

Problem

check the Kanban

vadasambar · 2023-05-09T04:40:38Z

May 09 2023

やったこと

get an OK for proceeding ahead on feat: support custom scheduler config (without extenders) kubernetes/autoscaler#5708 from the community
- had a discussion around this in the SIG meeting yesterday
- there are performance concerns around running an external scheduler extender
apply for Kubernetes community membership: https://github.com/kubernetes/community/blob/master/community-membership.md
- brought it up in the sig-autoscaling meeting. Waiting for the community's response
- https://docs.google.com/document/d/1RvhQAEIrVLHbyNnuaT99-6u9ZUMp7BfkPupT2LAZK7w/edit#
- got a go-ahead from the community (Guy and Elmiko are sponsoring me)
  - created issue: REQUEST: New membership for @vadasambar kubernetes/org#4203
  - added it to the SIG agenda doc so that I don't forget to follow up with Guy and elmiko
check Maciek's comment on feat: support custom scheduler config (without extenders) kubernetes/autoscaler#5708 (comment)
- replied: feat: support custom scheduler config (without extenders) kubernetes/autoscaler#5708 (comment)

vadasambar · 2023-05-10T04:38:12Z

May 10 2023

やったこと

address review comments for feat: support custom scheduler config (without extenders) kubernetes/autoscaler#5708
- remove code related to scheduler extenders: kubernetes/autoscaler@fade953
- moved code to generate/load scheduler config to a separate package: kubernetes/autoscaler@d58399d
address review comments for feat: support --scale-down-delay-after-* per nodegroup kubernetes/autoscaler#5729
- DONE
use clusterstate to figure out per node scale down in feat: support --scale-down-delay-after-* per nodegroup kubernetes/autoscaler#5729

WIP

TODO

check out new comments in Cluster Autoscaler resets unneeded since time to 0s kubernetes/autoscaler#5618
come up with a way to test feat: support custom scheduler config (without extenders) kubernetes/autoscaler#5708
- test with custom config for in-tree plugins
- add a comment in the PR
check if validating the config is really required for feat: support custom scheduler config (without extenders) kubernetes/autoscaler#5708
respond to new comment in Cluster autoscaler ignore node taints? kubernetes/autoscaler#4231
Cluster autoscaler ignore node taints? kubernetes/autoscaler#4231
- go through the code to understand what might be happening
check Add info about mirror pods in FAQ kubernetes/autoscaler#5566 (comment)
check comment support overprovsioning without pending pods kubernetes/autoscaler#5377 (comment)
check the Kanban

Problem

check the Kanban

vadasambar · 2023-05-11T04:15:41Z

May 11 2023

やったこと

started a thread in #sig-scheduling asking if the community is interested in supporting GRPC for scheduler extenders
- https://kubernetes.slack.com/archives/C09TP78DV/p1683784989107089
fix clusterstate tests failing in feat: support --scale-down-delay-after-* per nodegroup kubernetes/autoscaler#5729
- fixed: kubernetes/autoscaler@74706bc
fix static_autoscaler tests failing in feat: support custom scheduler config (without extenders) kubernetes/autoscaler#5708
- fixed: kubernetes/autoscaler@0cd2412

WIP

looking at supporting GRPC for scheduler extenders Consider using grpc to refactor scheduler extender interface kubernetes/kubernetes#60697
- it seems like the community is leaning more towards re-compiling the scheduler approach instead of supporting GRPC for extenders.