Skip to content

stdlib: Add Wattson TPU power estimation#5022

Merged
runpinglai-creator merged 2 commits intomainfrom
dev/runpinglai/tpu_stdlib
Mar 9, 2026
Merged

stdlib: Add Wattson TPU power estimation#5022
runpinglai-creator merged 2 commits intomainfrom
dev/runpinglai/tpu_stdlib

Conversation

@runpinglai-creator
Copy link
Copy Markdown
Contributor

Introduces a multi-dimensional TPU power model for Wattson, integrating frequency, cluster, and parallel request concurrency.

Key changes:

  • Created a non-linear TPU power curve LUT with support for workload-based scaling.
  • Implemented TPU frequency and cluster extraction from 'DVFS' tracks.
  • Clamped request lookups to 8 for now due to measurement limitations.

Bug: 454625451
Test: Wattson power estimation vs ground truth

Introduces a multi-dimensional TPU power model for Wattson, integrating
frequency, cluster, and parallel request concurrency.

Key changes:
- Created a non-linear TPU power curve LUT with support for
  workload-based scaling.
- Implemented TPU frequency and cluster extraction from 'DVFS' tracks.
- Clamped request lookups to 8 for now due to measurement limitations.

Bug: 454625451
Test: Wattson power estimation vs ground truth
Signed-off-by: Runping Lai <runpinglai@google.com>
@github-actions
Copy link
Copy Markdown

github-actions bot commented Mar 5, 2026

@wusamuel6
Copy link
Copy Markdown
Contributor

Do we need UI code updates?

@runpinglai-creator
Copy link
Copy Markdown
Contributor Author

runpinglai-creator commented Mar 5, 2026

Do we need UI code updates?

Yes. I have all the codes in hand but plan to send stdlib patch 1st, then UI patch 2nd, then metrics patch finally. Does that sound good?

@wusamuel6
Copy link
Copy Markdown
Contributor

Do we need UI code updates?

Yes. I have all the codes in hand but plan to send stdlib patch 1st, then UI patch 2nd, then metrics patch finally. Does that sound good?

Perfect, sounds good!

@runpinglai-creator runpinglai-creator marked this pull request as ready for review March 5, 2026 23:05
@runpinglai-creator runpinglai-creator requested a review from a team as a code owner March 5, 2026 23:05
@runpinglai-creator
Copy link
Copy Markdown
Contributor Author

Hey @stevegolton , could you please help with this review? Thanks!

@aMayzner aMayzner self-requested a review March 9, 2026 07:05
Copy link
Copy Markdown
Member

@aMayzner aMayzner left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review for the stdlib SQL part

@runpinglai-creator runpinglai-creator merged commit c812dd6 into main Mar 9, 2026
22 checks passed
@runpinglai-creator runpinglai-creator deleted the dev/runpinglai/tpu_stdlib branch March 9, 2026 08:02
@stevegolton
Copy link
Copy Markdown
Member

Hey @stevegolton , could you please help with this review? Thanks!

Looks like Anna's handled this. Ping me for the UI part!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants