Skip to content

Enable dumping raw prof files in AdvancedProfiler #28615

Enable dumping raw prof files in AdvancedProfiler

Enable dumping raw prof files in AdvancedProfiler #28615

Triggered via pull request June 21, 2024 16:13
Status Success
Total duration 31s
Artifacts

probot-auto-cc.yml

on: pull_request
Fit to window
Zoom out
Zoom in

Annotations

2 errors and 1 warning
auto-cc
Resource not accessible by integration { name: 'HttpError', id: '9616624001', status: 403, response: { url: 'https://api.github.com/repos/Lightning-AI/pytorch-lightning/pulls/19703', status: 403, headers: { 'access-control-allow-origin': '*', 'access-control-expose-headers': 'ETag, Link, Location, Retry-After, X-GitHub-OTP, X-RateLimit-Limit, X-RateLimit-Remaining, X-RateLimit-Used, X-RateLimit-Resource, X-RateLimit-Reset, X-OAuth-Scopes, X-Accepted-OAuth-Scopes, X-Poll-Interval, X-GitHub-Media-Type, X-GitHub-SSO, X-GitHub-Request-Id, Deprecation, Sunset', connection: 'close', 'content-encoding': 'gzip', 'content-security-policy': "default-src 'none'", 'content-type': 'application/json; charset=utf-8', date: 'Fri, 21 Jun 2024 16:14:09 GMT', 'referrer-policy': 'origin-when-cross-origin, strict-origin-when-cross-origin', server: 'GitHub.com', 'strict-transport-security': 'max-age=31536000; includeSubdomains; preload', 'transfer-encoding': 'chunked', vary: 'Accept-Encoding, Accept, X-Requested-With', 'x-accepted-github-permissions': 'pull_requests=write', 'x-content-type-options': 'nosniff', 'x-frame-options': 'deny', 'x-github-api-version-selected': '2022-11-28', 'x-github-media-type': 'github.v3; format=json', 'x-github-request-id': 'C040:3BAE5:41A9C19:4236D50:6675A6D1', 'x-ratelimit-limit': '15000', 'x-ratelimit-remaining': '14873', 'x-ratelimit-reset': '1718987564', 'x-ratelimit-resource': 'core', 'x-ratelimit-used': '127', 'x-xss-protection': '0' }, data: { message: 'Resource not accessible by integration', documentation_url: 'https://docs.github.com/rest/pulls/pulls#update-a-pull-request', status: '403' } }, request: { method: 'PATCH', url: 'https://api.github.com/repos/Lightning-AI/pytorch-lightning/pulls/19703', headers: { accept: 'application/vnd.github.v3+json', 'user-agent': 'probot/12.2.5 octokit-core.js/3.6.0 Node.js/16.20.2 (linux; x64)', authorization: 'token [REDACTED]', 'content-type': 'application/json; charset=utf-8' }, body: '{"body":"## What does this PR do?\\r\\n\\r\\nAdding a new `dump_stats` flag to `AdvanedProfiler` to persist `.prof` files collected during profiling. These files can be visualized by [SnakeViz](https://jiffyclub.github.io/snakeviz/) like so: `snakeviz fit-run-[Strategy]DDPStrategy.on_train_end.prof`\\r\\n\\r\\n<img width=\\"1380\\" alt=\\"Screenshot 2024-03-26 at 10 04 17 AM\\" src=\\"https://github.com/Lightning-AI/pytorch-lightning/assets/379115/b5b0b824-da13-4627-90a9-370186e2589e\\">\\r\\n\\r\\nA `.prof` file is created for each profiled action, e.g.:\\r\\n```\\r\\n...\\r\\nfit-run-[Strategy]DDPStrategy.on_train_end.prof\\r\\nfit-run-[Callback]TQDMProgressBar.on_fit_end.prof\\r\\nfit-run-[Callback]ModelSummary.on_fit_end.prof\\r\\nfit-run-[Callback]ModelCheckpoint{\'monitor\': None, \'mode\': \'min\', \'every_n_train_steps\': 0, \'every_n_epochs\': 1, \'train_time_interval\': None}.on_fit_end.prof\\r\\nfit-run-[Callback]LearningRateMonitor.on_fit_end.prof\\r\\n...\\r\\n```\\r\\n\\r\\n\\r\\nFixes #19698\\r\\n\\r\\nNo breaking changes, adding a new backward-compatible flag, with the new functionality disabled by default.\\r\\n\\r\\n<details>\\r\\n <summary><b>Before submitting</b></summary>\\r\\n\\r\\n- [x] Was this **discussed/agreed** via a GitHub issue? (not for typos and docs)\\r\\n- [x] Did you read the [contributor guideline](https://github.com/Lightning-AI/lightning/blob/master/.github/CONTRIBUTING.md), **Pull Request** section?\\r\\n- [x] Did you make sure your **PR does only one thing**, instead of bundling different changes together?\\r\\n- [x] Did you make sure to **update the documentation** with your changes? (if necessary)\\r\\n- [x] Did you write any **new necessary tests**? (not for typos and docs)\\r\\n- [x] Did you verify new and **existing tests pass** locally with your changes?\\r\\n- [x] Did you list all the **breaking ch
auto-cc
HttpError: Resource not accessible by integration at /home/runner/work/_actions/Lightning-AI/probot/v1/node_modules/@octokit/core/node_modules/@octokit/request/dist-node/index.js:86:21 at processTicksAndRejections (node:internal/process/task_queues:96:5) at async Job.doExecute (/home/runner/work/_actions/Lightning-AI/probot/v1/node_modules/bottleneck/light.js:405:18) { name: 'AggregateError', event: { id: '9616624001', name: 'pull_request', payload: { action: 'labeled', label: { color: 'E2FAEB', default: false, description: '', id: 2844047026, name: 'profiler', node_id: 'MDU6TGFiZWwyODQ0MDQ3MDI2', url: 'https://api.github.com/repos/Lightning-AI/pytorch-lightning/labels/profiler' }, number: 19703, organization: { avatar_url: 'https://avatars.githubusercontent.com/u/58386951?v=4', description: 'Turn ideas into AI, Lightning fast. Creators of PyTorch Lightning, Lightning AI Studio, TorchMetrics, Fabric, Lit-GPT, Lit-LLaMA', events_url: 'https://api.github.com/orgs/Lightning-AI/events', hooks_url: 'https://api.github.com/orgs/Lightning-AI/hooks', id: 58386951, issues_url: 'https://api.github.com/orgs/Lightning-AI/issues', login: 'Lightning-AI', members_url: 'https://api.github.com/orgs/Lightning-AI/members{/member}', node_id: 'MDEyOk9yZ2FuaXphdGlvbjU4Mzg2OTUx', public_members_url: 'https://api.github.com/orgs/Lightning-AI/public_members{/member}', repos_url: 'https://api.github.com/orgs/Lightning-AI/repos', url: 'https://api.github.com/orgs/Lightning-AI' }, pull_request: { _links: { comments: { href: 'https://api.github.com/repos/Lightning-AI/pytorch-lightning/issues/19703/comments' }, commits: { href: 'https://api.github.com/repos/Lightning-AI/pytorch-lightning/pulls/19703/commits' }, html: { href: 'https://github.com/Lightning-AI/pytorch-lightning/pull/19703' }, issue: { href: 'https://api.github.com/repos/Lightning-AI/pytorch-lightning/issues/19703' }, review_comment: { href: 'https://api.github.com/repos/Lightning-AI/pytorch-lightning/pulls/comments{/number}' }, review_comments: { href: 'https://api.github.com/repos/Lightning-AI/pytorch-lightning/pulls/19703/comments' }, self: { href: 'https://api.github.com/repos/Lightning-AI/pytorch-lightning/pulls/19703' }, statuses: { href: 'https://api.github.com/repos/Lightning-AI/pytorch-lightning/statuses/8ae52efd15227daf2fdfc1c0d4ed7b4749126109' } }, active_lock_reason: null, additions: 45, assignee: null, assignees: [], author_association: 'CONTRIBUTOR', auto_merge: null, base: { label: 'Lightning-AI:master', ref: 'master', repo: { allow_auto_merge: false, allow_forking: true, allow_merge_commit: false, allow_rebase_merge: true, allow_squash_merge: true, allow_update_branch: true, archive_url: 'https://api.github.com/repos/Lightning-AI/pytorch-lightning/{archive_format}{/ref}', archived: false, assignees_url: 'https://api.github.com/repos/Lightning-AI/pytorch-lightning/assignees{/user}', blobs_url: 'https://api.github.com/repos/Lightning-AI/pytorch-lightning/git/blobs{/sha}', branches_url: 'https://api.github.com/repos/Lightning-AI/pytorch-lightning/branches{/branch}', clone_url: 'https://github.com/Lightning-AI/pytorch-lightning.git', collaborators_url: 'https://api.github.com/repos/Lightning-AI/pytorch-lightning/collaborators{/collaborator}', comments_url: 'https://api.github.com/repos/Lightning-AI/pytorch-lightning/comments{/numb
auto-cc
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: Lightning-AI/probot@v1. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.