Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Task] Add support for saving chrome trace files to s3 urls and Azure blob #177

Closed
chauhang opened this issue Apr 20, 2021 · 2 comments
Closed
Assignees
Labels
plugin PyTorch Profiler TensorBoard Plugin related
Milestone

Comments

@chauhang
Copy link

Add support for saving the generated chrome trace files to s3 URLs. This works for Tensorboard SummaryWriter but is not supported for the Profiler traces.

Current Behavior
on_trace_ready=torch.profiler.tensorboard_trace_handler('s3://tb-demo/pytorch/')

Creates local files like:

(base) ubuntu@ip-172-31-22-142:~$ ls 
s3\:/tb-demo/pytorch/ip-172-31-22-142_14545.1618682202565.pt.trace.json 
s3:/tb-demo/pytorch/ip-172-31-22-142_14545.1618682202565.pt.trace.json

Expected Behavior
The chrome trace files should be saved in the S3 bucket

@guotuofeng guotuofeng added the plugin PyTorch Profiler TensorBoard Plugin related label Apr 21, 2021
@guotuofeng
Copy link
Contributor

#182

@nbcsm nbcsm changed the title Add support for saving chrome trace files to s3 urls Add support for saving chrome trace files to s3 urls and Azure blob Apr 22, 2021
@nbcsm nbcsm added this to the plugin v0.2 milestone Apr 22, 2021
@nbcsm nbcsm changed the title Add support for saving chrome trace files to s3 urls and Azure blob [Task] Add support for saving chrome trace files to s3 urls and Azure blob Apr 22, 2021
@guotuofeng
Copy link
Contributor

Add documentation work item: #196

@guotuofeng guotuofeng self-assigned this Apr 29, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
plugin PyTorch Profiler TensorBoard Plugin related
Projects
None yet
Development

No branches or pull requests

3 participants