[Release] Katib 0.18 Roadmap

[andreyvelich]

Let's use this issue as a placeholder for Katib 0.18 roadmap.
We will discuss the items on the upcoming AutoML WG calls.

• HP Optimization API for LLMs
• Push-based metrics collection
• Support log-uniform, normal, and other parameter distributions
• Kubernetes 1.28 - 1.31 support: Support Kubernetes v1.28 - v1.31 #2457
• [GSOC] Project 8: Support various Parameter Distribution in Katib #2374
• [GSoC] Project 6: Push-based Metrics Collection for Katib #2340
• [GSoC] Project 4: Hyperparameter Optimization API in Katib for LLMs #2339

[Electronic-Waste]

I'm thrilled to see that our GSoC proposals can be turned into a part of the formal release. Let's just do it!

@kubeflow/wg-automl-leads @tariq-hasan @shivas1516 @helenxie-bit @shashank-iitbhu .

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[andreyvelich]

/remove-lifecycle stale

[varodrig]

@andreyvelich should we close this issue?

[andreyvelich]

We haven't released Katib 0.18 yet, so we can keep this tracking issue.

[Electronic-Waste]

Remaining PRs to be reviewed/merged in Katib 0.18:

Features in RoadMap(high priority):

• [GSOC] hyperopt suggestion service logic update #2412
• [GSOC] optuna suggestion service logic update #2446
• [GSoC] Add unit tests for tune API #2423
• [GSoC] Add e2e test for tune api with LLM hyperparameter optimization #2420 (move to rc.1)
• [GSoC] Provide a PyTorch MNIST Example for Push-based Metrics Collection #2437

Fixes:

• [SDK] improve PVC creation name error #2496
• [SDK] Fix namespace label #2493 (TBD)
• [SDK] Update tune API #2497
• fix(api): resolve all api voilation exceptions in katib api #2482

Others(optional):

• chore: supporting the listen-address parameter on db-manager #2465
• Set experiment names at a max of 40 characters.  #2468
• Add KATIB_EXPERIMENT_NAME to pod env. #2488
• Sort experiments by descending creation date by default in katib-ui #2498
• [Test] E2e Tests for Notebook Examples #2417
• [SDK]Support Docker image as objective in the tune API #2338

We need some help to review these PRs, since Kubeflow Platform is releasing 1.10 this week.

cc👀 @kubeflow/wg-automl-leads @kubeflow/wg-manifests-leads @kubeflow/release-team @helenxie-bit @tariq-hasan @varodrig @Doris-xm @truc0 @AydanPirani @mahdikhashan

[juliusvonkohout]

@andreyvelich @Electronic-Waste can you check #2510 and kubeflow/manifests#2981 for the Katib release? This is what we need for Kubeflow 1.10 it seems.