Skip to content

Add translation-bench run config loader - #2856

Merged
Dominic Nguyen (datduyng) merged 1 commit into
domnguyen/tb-tpm-rate-limiterfrom
domnguyen/tb-run-config
Aug 12, 2026
Merged

Add translation-bench run config loader#2856
Dominic Nguyen (datduyng) merged 1 commit into
domnguyen/tb-tpm-rate-limiterfrom
domnguyen/tb-run-config

Conversation

@datduyng

Copy link
Copy Markdown
Contributor

Load JSON run configs and resolve per-model concurrency from TPM limits.

- Load and schema-merge batch config over a shared base
- Derive per-model concurrency from TPM limits and headroom
- Expose tpmLimits for the rate limiter and fail on unknown batches
@datduyng
Dominic Nguyen (datduyng) marked this pull request as ready for review August 12, 2026 20:57
@datduyng
Dominic Nguyen (datduyng) merged commit edd37b5 into domnguyen/tb-tpm-rate-limiter Aug 12, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants