Skip to content

Conversation

@prishajain1
Copy link
Collaborator

@prishajain1 prishajain1 commented Nov 17, 2025

TensorBoard logging for inference metrics

This change introduces TensorBoard scalar summaries to track key performance metrics during video generation inference.

Metrics added/logging:

  • inference/compile_time: Total time for compilation
  • inference/generation_time: Total time for a generation batch.
  • inference/generation_time_per_video: Average time to generate a single video across all devices.
  • inference/generation_time_with_profiler: Total time for a generation batch when the profiler is active.

These metrics will be written to the specified tensorboard_dir to help monitor and analyze inference performance.
This change is necessary to support integration with uBench for nightly regression tests which requires these metrics to be logged using TensorBoard

@github-actions
Copy link

@prishajain1 prishajain1 requested a review from entrpn November 17, 2025 04:54
@prishajain1 prishajain1 requested a review from entrpn November 18, 2025 06:57
@entrpn entrpn merged commit ba041cb into main Nov 18, 2025
2 of 3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants