Skip to content

Refactor CI to be more fine-grain#1385

Closed
scotts wants to merge 2 commits into
pytorch:mainfrom
scotts:ci_fine_grain
Closed

Refactor CI to be more fine-grain#1385
scotts wants to merge 2 commits into
pytorch:mainfrom
scotts:ci_fine_grain

Conversation

@scotts
Copy link
Copy Markdown
Contributor

@scotts scotts commented Apr 29, 2026

Our CI on main combines Kineto build and test with PyTorch build and test. Kineto build and test takes minutes; PyTorch build and test takes over an hour sometimes.

This PR splits those out so that we:

  1. Get quicker signals from Kineto build and test.
  2. Make it easier to reason about PyTorch build and test since it no longer contains Kineto build and test at all. There's no need to build Kineto because PyTorch build will handle it.

I tried to make it so that we could run all architectures on all PRs, but the actual CI systems those jobs run on need the label. So we still have to do ciflow/rocm and ciflow/xpu.

@scotts scotts marked this pull request as ready for review April 29, 2026 21:02
@meta-codesync
Copy link
Copy Markdown

meta-codesync Bot commented Apr 30, 2026

@scotts has imported this pull request. If you are a Meta employee, you can view this in D103106850.

@meta-codesync
Copy link
Copy Markdown

meta-codesync Bot commented Apr 30, 2026

@scotts merged this pull request in f78048c.

pytorchmergebot pushed a commit to pytorch/pytorch that referenced this pull request May 11, 2026
Includes the following commits:

- Replace LIBKINETO_NO* build flags with KINETO_BACKEND (pytorch/kineto#1388) 7739225
- Add git fetch <path_to_kineto_repo> main (pytorch/kineto#1384) 63cc35e
- Daily `arc lint --take CLANGFORMAT` (pytorch/kineto#1386) b40959c
- Introduce XPU scope profiler extending existing XPU profiler plugin (pytorch/kineto#1174) d636a94
- Refactor CI to be more fine-grain (pytorch/kineto#1385) f78048c
Pull Request resolved: #182973
Approved by: https://github.com/divyanshk
dsashidh pushed a commit to dsashidh/pytorch that referenced this pull request May 13, 2026
Includes the following commits:

- Replace LIBKINETO_NO* build flags with KINETO_BACKEND (pytorch/kineto#1388) 7739225
- Add git fetch <path_to_kineto_repo> main (pytorch/kineto#1384) 63cc35e
- Daily `arc lint --take CLANGFORMAT` (pytorch/kineto#1386) b40959c
- Introduce XPU scope profiler extending existing XPU profiler plugin (pytorch/kineto#1174) d636a94
- Refactor CI to be more fine-grain (pytorch/kineto#1385) f78048c
Pull Request resolved: pytorch#182973
Approved by: https://github.com/divyanshk
Alokksinha00 pushed a commit to Alokksinha00/pytorch that referenced this pull request May 15, 2026
Includes the following commits:

- Replace LIBKINETO_NO* build flags with KINETO_BACKEND (pytorch/kineto#1388) 7739225
- Add git fetch <path_to_kineto_repo> main (pytorch/kineto#1384) 63cc35e
- Daily `arc lint --take CLANGFORMAT` (pytorch/kineto#1386) b40959c
- Introduce XPU scope profiler extending existing XPU profiler plugin (pytorch/kineto#1174) d636a94
- Refactor CI to be more fine-grain (pytorch/kineto#1385) f78048c
Pull Request resolved: pytorch#182973
Approved by: https://github.com/divyanshk
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant