Skip to content

b9154

Latest

Choose a tag to compare

@github-actions github-actions released this 06 Jul 18:32
· 13 commits to turboquant-rebase since this release

scripts : add Bayesian Optimization hyperparameter tuner

Creates optimize_hyperparams.py — wraps existing bash benchmark scripts
with wangronin/bayes-optim to automatically find optimal runtime parameters.

Search space groups: cache (ctk/ctv types), batch (b/ub), compute (fa/ngl/threads),
moe (n-cpu-moe-range), prompt (n_prompt/n_gen).

Falls back to random search when bayes-optim is not installed.

Assisted-by: opencode

Linux (AMD RDNA2 — RX 6800 XT / gfx1030):