Working setup with runnable PyTorch on Codex. #159968

ezyang · 2025-08-06T17:19:10Z

Stack from ghstack (oldest at bottom):

-> Working setup with runnable PyTorch on Codex. #159968

Sample transcript: https://chatgpt.com/s/cd_68938effc1a88191ae78bc82a8cefe94

This makes use of #159965 to bypass doing an actual build and use nightly.

Things to improve:

Once USE_NIGHTLY is in main can remove the patching
We should just keep using the latest nightly, instead of a hard coded one

Signed-off-by: Edward Yang ezyang@meta.com

[ghstack-poisoned]

pytorch-bot · 2025-08-06T17:19:13Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/159968

📄 Preview Python docs built from this PR
📄 Preview C++ docs built from this PR
❓ Need help or want to give feedback on the CI? Visit the bot commands wiki or our office hours

Note: Links to docs will display an error until the docs builds have been completed.

✅ You can merge normally! (1 Unrelated Failure)

As of commit d87c7bc with merge base 79eca46 ():

UNSTABLE - The following job is marked as unstable, possibly due to flakiness on trunk:

pull / linux-jammy-py3_9-clang9-xla / test (xla, 1, 1, lf.linux.12xlarge, unstable) (gh) (#158876)
/var/lib/jenkins/workspace/xla/torch_xla/csrc/runtime/BUILD:476:14: Compiling torch_xla/csrc/runtime/xla_util_test.cpp failed: (Exit 1): gcc failed: error executing CppCompile command (from target //torch_xla/csrc/runtime:xla_util_test) /usr/bin/gcc -U_FORTIFY_SOURCE -fstack-protector -Wall -Wunused-but-set-parameter -Wno-free-nonheap-object -fno-omit-frame-pointer -g0 -O2 '-D_FORTIFY_SOURCE=1' -DNDEBUG -ffunction-sections ... (remaining 229 arguments skipped)

This comment was automatically generated by Dr. CI and updates every 15 minutes.

Signed-off-by: Edward Yang <ezyang@meta.com> ghstack-source-id: 47d7105 Pull-Request: #159968

albanD · 2025-08-06T17:32:07Z

codex_setup.sh

+#COMMIT=$(curl -s https://api.github.com/repos/pytorch/pytorch/branches/nightly | jq ".commit.commit.message" | sed -E 's/.*\(([0-9a-f]{40})\).*/\1/')
+git reset --hard 74a754aae98aabc2aca67e5edb41cc684fae9a82
+curl https://patch-diff.githubusercontent.com/raw/pytorch/pytorch/pull/159965.diff | patch -p1
+USE_NIGHTLY=2.9.0.dev20250806+cpu python setup.py develop


Why not checkout the nightly branch and pull in the latest nightly? These two should give you matching versions (expect for ~1h in the middle of the night).

I can't checkout nightly branch, Codex does a very minimal git checkout that doesn't even have origin remote setup

Signed-off-by: Edward Yang <ezyang@meta.com> ghstack-source-id: 47d7105 Pull-Request: #159968

[ghstack-poisoned]

Signed-off-by: Edward Yang <ezyang@meta.com> ghstack-source-id: 45b02bd Pull-Request: #159968

[ghstack-poisoned]

Signed-off-by: Edward Yang <ezyang@meta.com> ghstack-source-id: 5adda6c Pull-Request: #159968

[ghstack-poisoned]

Signed-off-by: Edward Yang <ezyang@meta.com> ghstack-source-id: 132668d Pull-Request: #159968

ezyang · 2025-08-08T14:32:10Z

@pytorchbot merge -f "unrelated failure"

pytorchmergebot · 2025-08-08T14:34:02Z

Merge started

Your change will be merged immediately since you used the force (-f) flag, bypassing any CI checks (ETA: 1-5 minutes). Please use -f as last resort and instead consider -i/--ignore-current to continue the merge ignoring current failures. This will allow currently pending tests to finish and report signal before the merge.

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging

Check the merge workflow status
here

Sample transcript: https://chatgpt.com/s/cd_68938effc1a88191ae78bc82a8cefe94 This makes use of pytorch#159965 to bypass doing an actual build and use nightly. Things to improve: - Once USE_NIGHTLY is in main can remove the patching - We should just keep using the latest nightly, instead of a hard coded one Signed-off-by: Edward Yang <ezyang@meta.com> Pull Request resolved: pytorch#159968 Approved by: https://github.com/wdvr

Update

808dfbc

[ghstack-poisoned]

ezyang added a commit that referenced this pull request Aug 6, 2025

Working setup with runnable PyTorch on Codex.

b0d4b42

Signed-off-by: Edward Yang <ezyang@meta.com> ghstack-source-id: 47d7105 Pull-Request: #159968

github-actions bot requested review from albanD, antoniojkim, bdhirsh, miladm and SherlockNoMad August 6, 2025 17:19

ezyang requested review from seemethere, malfet and wdvr August 6, 2025 17:21

ezyang added a commit that referenced this pull request Aug 6, 2025

Working setup with runnable PyTorch on Codex.

56ef7aa

Signed-off-by: Edward Yang <ezyang@meta.com> ghstack-source-id: 47d7105 Pull-Request: #159968

albanD reviewed Aug 6, 2025

View reviewed changes

ezyang added a commit that referenced this pull request Aug 6, 2025

Working setup with runnable PyTorch on Codex.

adc96c6

Signed-off-by: Edward Yang <ezyang@meta.com> ghstack-source-id: 47d7105 Pull-Request: #159968

Update

8131844

[ghstack-poisoned]

ezyang added a commit that referenced this pull request Aug 6, 2025

Working setup with runnable PyTorch on Codex.

cea9c36

Signed-off-by: Edward Yang <ezyang@meta.com> ghstack-source-id: 45b02bd Pull-Request: #159968

ezyang added a commit that referenced this pull request Aug 6, 2025

Working setup with runnable PyTorch on Codex.

db9d3bd

Signed-off-by: Edward Yang <ezyang@meta.com> ghstack-source-id: 45b02bd Pull-Request: #159968

ezyang added a commit that referenced this pull request Aug 6, 2025

Working setup with runnable PyTorch on Codex.

a41c8cd

Signed-off-by: Edward Yang <ezyang@meta.com> ghstack-source-id: 45b02bd Pull-Request: #159968

ezyang added a commit that referenced this pull request Aug 6, 2025

Working setup with runnable PyTorch on Codex.

5415fa6

Signed-off-by: Edward Yang <ezyang@meta.com> ghstack-source-id: 45b02bd Pull-Request: #159968

ezyang added a commit that referenced this pull request Aug 6, 2025

Working setup with runnable PyTorch on Codex.

ef49931

Signed-off-by: Edward Yang <ezyang@meta.com> ghstack-source-id: 45b02bd Pull-Request: #159968

ezyang added a commit that referenced this pull request Aug 6, 2025

Working setup with runnable PyTorch on Codex.

f2348b1

Signed-off-by: Edward Yang <ezyang@meta.com> ghstack-source-id: 45b02bd Pull-Request: #159968

ezyang added a commit that referenced this pull request Aug 6, 2025

Working setup with runnable PyTorch on Codex.

3e7ee80

Signed-off-by: Edward Yang <ezyang@meta.com> ghstack-source-id: 45b02bd Pull-Request: #159968

ezyang added a commit that referenced this pull request Aug 6, 2025

Working setup with runnable PyTorch on Codex.

e23c1ad

Signed-off-by: Edward Yang <ezyang@meta.com> ghstack-source-id: 45b02bd Pull-Request: #159968

ezyang added a commit that referenced this pull request Aug 6, 2025

Working setup with runnable PyTorch on Codex.

f610175

Signed-off-by: Edward Yang <ezyang@meta.com> ghstack-source-id: 45b02bd Pull-Request: #159968

ezyang added a commit that referenced this pull request Aug 6, 2025

Working setup with runnable PyTorch on Codex.

8ffb56d

Signed-off-by: Edward Yang <ezyang@meta.com> ghstack-source-id: 45b02bd Pull-Request: #159968

ezyang added a commit that referenced this pull request Aug 6, 2025

Working setup with runnable PyTorch on Codex.

cf0911d

Signed-off-by: Edward Yang <ezyang@meta.com> ghstack-source-id: 45b02bd Pull-Request: #159968

ezyang added a commit that referenced this pull request Aug 6, 2025

Working setup with runnable PyTorch on Codex.

9bbcc99

Signed-off-by: Edward Yang <ezyang@meta.com> ghstack-source-id: 45b02bd Pull-Request: #159968

Update

201af54

[ghstack-poisoned]

ezyang added a commit that referenced this pull request Aug 6, 2025

Working setup with runnable PyTorch on Codex.

5085b3d

Signed-off-by: Edward Yang <ezyang@meta.com> ghstack-source-id: 5adda6c Pull-Request: #159968

ezyang added a commit that referenced this pull request Aug 6, 2025

Working setup with runnable PyTorch on Codex.

8315244

Signed-off-by: Edward Yang <ezyang@meta.com> ghstack-source-id: 5adda6c Pull-Request: #159968

ezyang added a commit that referenced this pull request Aug 6, 2025

Working setup with runnable PyTorch on Codex.

dd9508a

Signed-off-by: Edward Yang <ezyang@meta.com> ghstack-source-id: 5adda6c Pull-Request: #159968

ezyang added a commit that referenced this pull request Aug 6, 2025

Working setup with runnable PyTorch on Codex.

deb9c85

Signed-off-by: Edward Yang <ezyang@meta.com> ghstack-source-id: 5adda6c Pull-Request: #159968

Update

d87c7bc

[ghstack-poisoned]

ezyang added a commit that referenced this pull request Aug 6, 2025

Working setup with runnable PyTorch on Codex.

aadcbaf

Signed-off-by: Edward Yang <ezyang@meta.com> ghstack-source-id: 132668d Pull-Request: #159968

ezyang added a commit that referenced this pull request Aug 6, 2025

Working setup with runnable PyTorch on Codex.

bc67bce

Signed-off-by: Edward Yang <ezyang@meta.com> ghstack-source-id: 132668d Pull-Request: #159968

wdvr approved these changes Aug 7, 2025

View reviewed changes

pytorchmergebot added the merging label Aug 8, 2025

pytorchmergebot closed this in 9fa8ce2 Aug 8, 2025

pytorchmergebot added Merged and removed merging labels Aug 8, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Working setup with runnable PyTorch on Codex. #159968

Working setup with runnable PyTorch on Codex. #159968

Uh oh!

ezyang commented Aug 6, 2025 •

edited

Loading

Uh oh!

pytorch-bot bot commented Aug 6, 2025 •

edited

Loading

Uh oh!

albanD Aug 6, 2025

Uh oh!

ezyang Aug 6, 2025

Uh oh!

ezyang commented Aug 8, 2025

Uh oh!

pytorchmergebot commented Aug 8, 2025

Uh oh!

Uh oh!

Working setup with runnable PyTorch on Codex. #159968

Working setup with runnable PyTorch on Codex. #159968

Uh oh!

Conversation

ezyang commented Aug 6, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pytorch-bot bot commented Aug 6, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/159968

✅ You can merge normally! (1 Unrelated Failure)

Uh oh!

albanD Aug 6, 2025

Choose a reason for hiding this comment

Uh oh!

ezyang Aug 6, 2025

Choose a reason for hiding this comment

Uh oh!

ezyang commented Aug 8, 2025

Uh oh!

pytorchmergebot commented Aug 8, 2025

Merge started

Uh oh!

Uh oh!

ezyang commented Aug 6, 2025 •

edited

Loading

pytorch-bot bot commented Aug 6, 2025 •

edited

Loading