Skip to content

Conversation

@namanlalitnyu
Copy link
Contributor

@namanlalitnyu namanlalitnyu commented Sep 20, 2025

Changes

  • We are updating the S3 path in which the vLLM Profiling traces are stored.
  • The new path consists of the addition of "model_name", "device_type", and "device_name" in the earlier part of the prefix, to allow easy filtering of data which needs to be rendered in the HUD Dashboard.
    Eg: 2025-09-20/vllm-project/vllm/facebook_opt-125m/cuda/A100-SXM4-40GB/facebook_opt_125m_tp1_random/36429096171ff8785645c40c662d859dddedd829/17875548848/profiling/vllm.async_llm.pt.trace.json.gz
    This path is constructed as follows: <date>/<repo_name>/<model_name>/<device_type>/<device_name>/<test_name>/<commit_sha>/<github_workflow_id>/<github_job_id>/<file_name>

Testing

  • Verified that the Github action is uploading the profiling data to the correct path. link
Screenshot 2025-09-20 at 2 40 27 PM

Downloadable File link: https://gha-artifacts.s3.us-east-1.amazonaws.com/2025-09-20/vllm-project/vllm/facebook_opt-125m/cuda/A100-SXM4-40GB/facebook_opt_125m_tp1_random/bef180f00978186fcc84f7ca6328a6ae6c39676d/17884190582/profiling/vllm.async_llm.pt.trace.json.gz

@namanlalitnyu namanlalitnyu marked this pull request as ready for review September 20, 2025 18:56
@huydhn huydhn merged commit 2854c13 into main Sep 22, 2025
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants