Allow StatefulSet to control start replica ordinal numbering

[pwschuurman]

Enhancement Description

• One-line enhancement description (can be used as a release note): Added a feature that allows a StatefulSet to start numbering replicas from an arbitrary non-negative ordinal, using the .spec.ordinals.start field.
  • KEP-3335 Link
  • KEP-3335 PR: KEP-3335: StatefulSet Start Ordinal #3336
• Discussion Link:
  • sig-storage June 2, 2022
  • sig-apps June 13, 2022
  • sig-multicluster July 26, 2022
• Primary contact (assignee): @pwschuurman
• Responsible SIGs: sig-apps, sig-multicluster, sig-storage
• Enhancement target (which target equals to which milestone):
  • Alpha release target (x.y): 1.26
  • Beta release target (x.y): 1.27
  • Stable release target (x.y):
• Alpha
  • KEP (k/enhancements) update PR(s): KEP-3335: StatefulSet Start Ordinal #3336
  • Code (k/k) update PR(s): Add implementation of KEP-3335, StatefulSetSlice kubernetes#112744
  • Docs (k/website) update PR(s): Add initial documentation for StatefulSetSlice feature website#37224
• Beta
  • KEP (k/enhancements) update PR(s): KEP-3335: Update beta milestone to 1.27 #3768
  • Code (k/k) update PR(s): Move StatefulSetStartOrdinal feature gate to beta kubernetes#115260
  • Metrics (k/kube-state-metrics) update PR(s): Add StatefulSet Start Ordinal metrics for KEP-3335 kube-state-metrics#1959
  • Tests (k/k) unit PR(s): Add enablement/disablement unit test for StatefulSetStartOrdinal feature kubernetes#115536
  • Tests (k/k) integration PR(s): Add integration tests for StatefulSetStartOrdinal feature kubernetes#115466
  • Tests (k/k) e2e PR(s): Add e2e tests for StatefulSetStartOrdinal feature kubernetes#115468
  • Docs (k/website) update(s): Update StatefulSetStartOrdinal documentation to target beta in 1.27 website#39823

Please keep this description up to date. This will help the Enhancement Team to track the evolution of the enhancement efficiently.

[k8s-triage-robot]

The Kubernetes project currently lacks enough contributors to adequately respond to all issues and PRs.

This bot triages issues and PRs according to the following rules:

• After 90d of inactivity, lifecycle/stale is applied
• After 30d of inactivity since lifecycle/stale was applied, lifecycle/rotten is applied
• After 30d of inactivity since lifecycle/rotten was applied, the issue is closed

You can:

• Mark this issue or PR as fresh with /remove-lifecycle stale
• Mark this issue or PR as rotten with /lifecycle rotten
• Close this issue or PR with /close
• Offer to help out with Issue Triage

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle stale

[pwschuurman]

/sig multicluster

[JeremyOT]

/label lead-opted-in

[rhockenbury]

/milestone v1.26
/label tracked/yes
/stage alpha

[ruheenaansari34]

Hello @pwschuurman 👋, 1.26 Enhancements team here.

Just checking in as we approach enhancements freeze on 18:00 PDT on Thursday 6th October 2022.

This enhancement is targeting for stage alpha for 1.26 (correct me, if otherwise)

Here's where this enhancement currently stands:

• KEP readme using the latest template has been merged into the k/enhancements repo.
• KEP status is marked as implementable for latest-milestone: 1.26
• KEP readme has a updated detailed test plan section filled out
• KEP readme has up to date graduation criteria
• KEP has a production readiness review that has been completed and merged into k/enhancements.

For this KEP, we would just need to merge #3336, which will take care of above requirements.

The status of this enhancement is marked as at risk. Please keep the issue description up-to-date with appropriate stages as well. Thank you!

[ruheenaansari34]

Quick reminder - Enhancement freeze is 2 days away. If you are still looking to get this enhancement into v1.26, please plan to get the PR #3336 merged.

[pwschuurman]

Hi @ruheenaansari34, #3336 has been merged.

[pwschuurman]

/sig apps

[pwschuurman]

/remove-sig multicluster

[rhockenbury]

Thanks, the enhancements team has this marked as tracked now.

[soltysh]

/remove-lifecycle stale

[pwschuurman]

• Docs draft PR: Add initial documentation for StatefulSetSlice feature website#37224

[pwschuurman]

Hi @ruheenaansari34 @rhockenbury, this is currently marked as tracked by sig-multicluster, but the KEP is in sig-apps. Can the enhancements spreadsheet be updated to reflect the current state of this enhancement? https://github.com/orgs/kubernetes/projects/98/views/11?sortedBy%5Bdirection%5D=asc&sortedBy%5BcolumnId%5D=15217749&filterQuery=sig%3Asig-multicluster

[rhockenbury]

Thanks. Fixed.

[parul5sahoo]

Hi @pwschuurman 👋,

Checking in once more as we approach 1.26 code freeze at 17:00 PDT on Tuesday 8th November 2022.

Please ensure the following items are completed:

• All PRs to the Kubernetes repo that are related to your enhancement are linked in the above issue description (for tracking purposes). Open PR
• All PRs are fully merged by the code freeze deadline.

For this enhancement, please plan to get PRs out for all k/k code so it can be merged up by code freeze. If you do have k/k PRs open, please link them to this issue. Let me know if there aren't any further PRs that need to be created or merged for this enhancements, so that I can mark it as tracked.

As always, we are here to help should questions come up. Thanks!

[soltysh]

@pwschuurman are you planning to promote this to beta in 1.27?

[pwschuurman]

@soltysh Yes, I would like to promote to beta in 1.27. Working on the testing requirements for KEP in beta.

[pwschuurman]

@soltysh Would you be able to opt this KEP in for 1.27 release milestone (https://www.kubernetes.dev/blog/2022/09/09/enhancements-opt-in/)?

[soltysh]

/label lead-opted-in
/milestone v1.27
/stage beta

[pwschuurman]

@soltysh Do you mind to take a look at kubernetes/kubernetes#115468? I'd like to get the e2e tests submitted and running in testgrid (https://testgrid.k8s.io/google-gce#gci-gce-alpha-enabled-default) so we can have a clear signal prior to promoting the feature flag.

[soltysh]

@pwschuurman let's start with just that integration for now (from kubernetes/kubernetes#115466) as a starting point (which is already tagged and should merge shortly), and when promoting to beta and enabling the feature permanently we'll merge kubernetes/kubernetes#115468, wdyt?

[marosset]

Hello @pwschuurman 👋, Enhancements team here.

Just checking in as we approach enhancements freeze on 18:00 PDT Thursday 9th February 2023.

This enhancement is targeting for stage beta for v1.27 (correct me, if otherwise)

Here's where this enhancement currently stands:

• KEP readme using the latest template has been merged into the k/enhancements repo.
• KEP status is marked as implementable for latest-milestone: v1.27
• KEP readme has a updated detailed test plan section filled out
• KEP readme has up to date graduation criteria
• KEP has a production readiness review that has been completed and merged into k/enhancements.

For this enhancement it looks like #3768 will address all of these requirements.

The status of this enhancement is marked as at risk. Please keep the issue description up-to-date with appropriate stages as well.
Thank you!

[marosset]

With #3768 this enhancement is ready to be tracked for v1.27
Thanks!

[marosset]

Hi @pwschuurman 👋,

Checking in as we approach 1.27 code freeze at 17:00 PDT on Tuesday 14th March 2023.

Please ensure the following items are completed:

• All PRs to the Kubernetes repo that are related to your enhancement are linked in the above issue description (for tracking purposes).
• All PRs are fully merged by the code freeze deadline.

For this enhancement, it looks like the following PRs are open and need to be merged before code freeze:

• Move StatefulSetStartOrdinal feature gate to beta kubernetes#115260
• Add e2e tests for StatefulSetStartOrdinal feature kubernetes#115468

Please let me know if there are any other PRs in k/k I should be tracking for this KEP.

As always, we are here to help should questions come up. Thanks!

[pwschuurman]

Hi @marosset,

For this enhancement, it looks like the following PRs are open and need to be merged before code freeze:

• Move StatefulSetStartOrdinal feature gate to beta kubernetes#115260
• Add e2e tests for StatefulSetStartOrdinal feature kubernetes#115468

Both of these are pending on API review for kubernetes/kubernetes#115260, but will be ready to merge after this approval.

Please let me know if there are any other PRs in k/k I should be tracking for this KEP.

I also have a PR in kube-state-metrics: kubernetes/kube-state-metrics#1959. I'm assuming this does not need to be merged by code freeze, since it's not in the k/k repo?