[Executorch][LLM] Use caching allocator for runner #15730

kimishpatel · 2025-11-11T04:34:49Z

Stack from ghstack (oldest at bottom):

We observed that on iOS it improves perf by 6% because SDPA op does temp allocations.

No significant difference on android though.

Differential Revision: D86120038

We observed that on iOS it improves perf by 6% because SDPA op does temp allocations. No significant difference on android though. Differential Revision: [D86120038](https://our.internmc.facebook.com/intern/diff/D86120038/) [ghstack-poisoned]

pytorch-bot · 2025-11-11T04:34:53Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/15730

📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 122 New Failures

As of commit 00fffa1 with merge base aba44fd ():

NEW FAILURES - The following jobs have failed:

Build documentation / build (buck2) / Build doc (gh)
RuntimeError: Command docker exec -t 15dbddc0d8f7efb9cfd981a68a0117fe4eaba67f8220a12cfe8380360579da1f /exec failed with exit code 1
Build Presets / apple (ios-simulator) / build (gh)
RuntimeError: Command bash /Users/runner/work/_temp/exec_script failed with exit code 1
Build Presets / apple (ios) / build (gh)
RuntimeError: Command bash /Users/runner/work/_temp/exec_script failed with exit code 1
Build Presets / apple (llm) / build (gh)
Build Presets / apple (macos) / build (gh)
RuntimeError: Command bash /Users/runner/work/_temp/exec_script failed with exit code 1
Build Presets / apple (pybind) / build (gh)
RuntimeError: Command bash /Users/runner/work/_temp/exec_script failed with exit code 1
Build Presets / linux (linux, linux.2xlarge, executorch-ubuntu-22.04-clang12) / build (gh)
Build Presets / linux (linux, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11-aarch64) / build (gh)
RuntimeError: Command docker exec -t acf8378806537f4b47310637fd3d4d9d91fdb95d483e8b4ec2c48d8e7123a555 /exec failed with exit code 1
Build Presets / linux (llm, linux.2xlarge, executorch-ubuntu-22.04-clang12) / build (gh)
RuntimeError: Command docker exec -t 6d142d32c1ccbd6010c4ca15f32b4a249e224ae74e720cb7061f447ddc7e5b55 /exec failed with exit code 1
Build Presets / linux (llm, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11-aarch64) / build (gh)
RuntimeError: Command docker exec -t 5210fc10b61eca5ee2c9a6c68bae7a007cf10c4548157ced7a1ea938e9647040 /exec failed with exit code 1
Build Presets / linux (pybind, linux.2xlarge, executorch-ubuntu-22.04-clang12) / build (gh)
RuntimeError: Command docker exec -t b0184cc11be9f758ff15e1cec6f30d1f97ff0d217e05df7d314669a8b84b335e /exec failed with exit code 1
Build Presets / linux (pybind, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11-aarch64) / build (gh)
RuntimeError: Command docker exec -t eb8636aa07e22c07c318589a702c055920694c2db60b26e5cd22cc8e83e94ce2 /exec failed with exit code 1
Lint / lintrunner / linux-job (gh)
>>> Lint for CMakeLists.txt:
periodic / test-models-linux (buck2, mv3, portable, linux.2xlarge, 90) / linux-job (gh)
RuntimeError: Command docker exec -t 74ce0018bc3b29f18fd2d300ab7d35169647e8ba03e9666efe0c70eb1c74bc39 /exec failed with exit code 1
periodic / test-models-linux (buck2, mv3, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
RuntimeError: Command docker exec -t 17166fd56f8bbb253c6e7674eb3af2079d1920fa008e3d0429c9ac6111f9289d /exec failed with exit code 1
periodic / test-models-linux (cmake, mv3, portable, linux.2xlarge, 90) / linux-job (gh)
RuntimeError: Command docker exec -t adde903e7d8f64720f13620eb94d38ee21914725988ae017236718cb537cf9ab /exec failed with exit code 1
periodic / test-models-linux (cmake, mv3, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
RuntimeError: Command docker exec -t 77b50dfa08263ad3d32f2889004c4962cdc33dcb61754c860b382b9d0ad224ce /exec failed with exit code 1
periodic / test-models-linux (cmake, vit, portable, linux.2xlarge, 90) / linux-job (gh)
RuntimeError: Command docker exec -t 064af5bd38f07bf7b5700d17efdf2a7627c90aa541a8380a75c9a9c771747000 /exec failed with exit code 1
periodic / test-models-linux (cmake, vit, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
RuntimeError: Command docker exec -t 55538cc68a91bfbec65e8a34300ffd716f26ae016fdd765fea8d655fa61db471 /exec failed with exit code 1
pull / android / build-llm-demo / linux-job (gh)
RuntimeError: Command docker exec -t 1b277d39d44027f5d7cea21516dfb7a467e83452fc4161a593d0ba17427768bf /exec failed with exit code 1
pull / test-build-wasm-linux / linux-job (gh)
RuntimeError: Command docker exec -t d4da9f0894056713f6c8870d1c671bbf9532c276093e76371643c4d43546a847 /exec failed with exit code 1
pull / test-custom-ops-linux / linux-job (gh)
RuntimeError: Command docker exec -t 6db21f71899921fc711580b2dee4d988fa8f97c35ffc037adb9d4e900d064589 /exec failed with exit code 1
pull / test-eval_llama-wikitext-linux / linux-job (gh)
RuntimeError: Command docker exec -t e3e17a479e52b69a6412de160a0088cd423ffca41119e597686ba0e6fb08ee58 /exec failed with exit code 1
pull / test-llama_runner_eager-linux / linux-job (gh)
RuntimeError: Command docker exec -t 9ac02cec911c03ad17c3458d537903cd6f76b0457b7946f35d03c13dce96f9da /exec failed with exit code 1
pull / test-llama-lora-linux / linux-job (gh)
RuntimeError: Command docker exec -t 9b2678a59cacbf65bbd521a04a0f0d0035913a2ce01f4110bec289d5220463dc /exec failed with exit code 1
pull / test-llama-runner-linux (bf16, custom, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
RuntimeError: Command docker exec -t 3007587bd2c719185d5c6da756e709feeda97ec3b591c445760c0836b9c46a81 /exec failed with exit code 1
pull / test-llama-runner-linux (fp32, xnnpack+custom+qe, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
RuntimeError: Command docker exec -t fe9e5900c697dce0fd66504b87091007b8bd25870fe0f45b3717350bd69e4264 /exec failed with exit code 1
pull / test-llama-runner-linux (fp32, xnnpack+custom+qe, linux.arm64.2xlarge, executorch-ubuntu-22.04-gc... / linux-job (gh)
RuntimeError: Command docker exec -t 97b372a3a8ae6b4e03d625923916ec7af030b80044398711a157100373a0c2be /exec failed with exit code 1
pull / test-llama-runner-linux (fp32, xnnpack+custom+quantize_kv, linux.2xlarge, executorch-ubuntu-22.04... / linux-job (gh)
RuntimeError: Command docker exec -t eac85935c77195a593af52e842e7dfc47f7d705059968aead2fa5db350cf37e8 /exec failed with exit code 1
pull / test-llama-runner-linux (fp32, xnnpack+custom+quantize_kv, linux.arm64.2xlarge, executorch-ubuntu... / linux-job (gh)
RuntimeError: Command docker exec -t c563b47fd45d204260a8d816055e4ae5c9ca76d0093eee5c6dc1bcc8810c2d11 /exec failed with exit code 1
pull / test-llama-runner-linux (fp32, xnnpack+quantize_kv, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
RuntimeError: Command docker exec -t ebf575701076eb249b4ba30d6b06f92fdf79df4157796491f0cdfbe54d042e25 /exec failed with exit code 1
pull / test-llama-runner-linux (fp32, xnnpack+quantize_kv, linux.arm64.2xlarge, executorch-ubuntu-22.04-... / linux-job (gh)
RuntimeError: Command docker exec -t e22a54ce559750384b57b193e2c19fae76d6d42bc67f0e33c233d17922b302fb /exec failed with exit code 1
pull / test-llama-runner-linux-android / linux-job (gh)
RuntimeError: Command docker exec -t 02fd741f72e9d6f7b900388df399fb5f3418172a2565509df7ef846aeede4881 /exec failed with exit code 1
pull / test-llama-runner-qnn-linux (fp32, qnn_16a16w, qnn) / linux-job (gh)
RuntimeError: Command docker exec -t 909690d4a876381532b4b9019d154e9d2c4b0285b2a50dbb72de6d43fe703cef /exec failed with exit code 1
pull / test-llama-runner-qnn-linux (fp32, qnn_8a8w, qnn) / linux-job (gh)
RuntimeError: Command docker exec -t 9b4d4d8d8cf14633c97ad610bb2a745f1933deadd0ff5c4b79589b34d5f3a394 /exec failed with exit code 1
pull / test-mediatek-models-linux / linux-job (gh)
RuntimeError: Command docker exec -t 215e6d7a0102f9e957b125a2ed39b8182a66027f9b408b9c8b073ecd48209958 /exec failed with exit code 1
pull / test-models-linux (add_mul, portable, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t 3dae5b01e3f8c4a908461c5b72f50b88cb98f606cfe7a3e566937017ac1c962a /exec failed with exit code 1
pull / test-models-linux (add_mul, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t d62a6e3a076a7ceae4e9f562125908d09d17bb25dee564faee587bdb388b893d /exec failed with exit code 1
pull / test-models-linux (add, portable, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t c5dfd969686801a2ce8a8a7fa3df4ecbf6cc47e752656051eb5f85d2b960bb6d /exec failed with exit code 1
pull / test-models-linux (add, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t 6089fe11ef6f998db17568bc21114c3f1c85daceb18fe2efcc208108e4124701 /exec failed with exit code 1
pull / test-models-linux (emformer_join, portable, linux.4xlarge.memory) / linux-job (gh)
RuntimeError: Command docker exec -t 5c54510cf444297ee02e4080bb0bdf7ae5e019225d0374b0265d37e26f99664c /exec failed with exit code 1
pull / test-models-linux (emformer_join, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
RuntimeError: Command docker exec -t 1fcf2d6840fd0cd97e32c95017f10581675406db2c4e4e25e210123dc5f192ff /exec failed with exit code 1
pull / test-models-linux (emformer_transcribe, portable, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t 6393a1a66859e0f045738dbfa754db44e1507695225ce910f1fbcf29643fc1eb /exec failed with exit code 1
pull / test-models-linux (emformer_transcribe, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t b9533f63720ef28e38890eef20d57d7188574e690b90603c19a7d14c3afd912e /exec failed with exit code 1
pull / test-models-linux (ic3, portable, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t 592f9fe3c89f12f54bd3eb75e300f72e5997b36ebaa66153fe38c0a0fd2e4fce /exec failed with exit code 1
pull / test-models-linux (ic3, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t 0b391e15fb447f110661ab58aff3be98e3762d1918d6ac8bb068dde54a07a5dc /exec failed with exit code 1
pull / test-models-linux (ic4, portable, linux.4xlarge.memory) / linux-job (gh)
RuntimeError: Command docker exec -t a7cb3e8157b134fd867d3234859f962abd9dc072649080f3ad0eb42f923827a3 /exec failed with exit code 1
pull / test-models-linux (ic4, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
RuntimeError: Command docker exec -t 65cf9ec76adc754f1a399d73801bc66e6cadb336f57735ab6dce4ddaf0d77192 /exec failed with exit code 1
pull / test-models-linux (linear, portable, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t 83b8e9794dd7154efda40d1c0a189514ddcd9386667add19e0cc856065feaed9 /exec failed with exit code 1
pull / test-models-linux (linear, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t a5917995795f1e85c217f3c6612e1350b5e1528f48e0b759e95443804368eeb2 /exec failed with exit code 1
pull / test-models-linux (llama3_2_vision_encoder, portable, linux.4xlarge.memory) / linux-job (gh)
RuntimeError: Command docker exec -t d0809b471964ed1b08d6a00ed7aee9d43b148481f3c116be53e98bf0f39df826 /exec failed with exit code 1
pull / test-models-linux (mobilebert, portable, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t b521155f733660bfac230447f9c5578ca5416f7b1170f8f725aef38afcc9628d /exec failed with exit code 1
pull / test-models-linux (mobilebert, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t b0c0595c960b05253723464760a2d65dc125145115c5bb285ff3136460ea38fb /exec failed with exit code 1
pull / test-models-linux (mv2, portable, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t 3de7aea8a3b4751e19c05b320e763af953b16bffc9f94298576a6160b9b08787 /exec failed with exit code 1
pull / test-models-linux (mv2, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t 3432d9d6171672d0be63f851e9bd0ce3ea9b4049b5e558d4da1ae4b61e3453c6 /exec failed with exit code 1
pull / test-models-linux (phi_4_mini, portable, linux.4xlarge.memory) / linux-job (gh)
RuntimeError: Command docker exec -t 9b5ffa2dcbca30b86cc1941567a2416f56b40612f1274e0d7d8d78659f5d96e9 /exec failed with exit code 1
pull / test-models-linux (resnet18, portable, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t d94c12f6d1c10e80aedc48fb812eab0bbf44a52f77d7c42ecde279fc88188fa2 /exec failed with exit code 1
pull / test-models-linux (resnet18, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t b9878a66e19a8cbf9e029d4afa7aa430243f277d4700df2152b7ce640d2e6187 /exec failed with exit code 1
pull / test-models-linux (resnet50, portable, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t 5d6300c8c53b43a2b2f6270b8b506b062a7c1920696c6cb47a05b884b82cd4fd /exec failed with exit code 1
pull / test-models-linux (resnet50, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t ab7ed402b158fdc7a06c948a94b4a54c9cc1ee5c878d851300159f310a304e4a /exec failed with exit code 1
pull / test-models-linux (w2l, portable, linux.4xlarge.memory) / linux-job (gh)
RuntimeError: Command docker exec -t 9af58e09f3f2b241d58a67f19f4688331d5d878321cb9ae2f795d36cf97bd86c /exec failed with exit code 1
pull / test-models-linux-basic (mv3, portable, buck2, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
RuntimeError: Command docker exec -t 49d5c6a552dafcc5390206545fd048eed531784bdc463c57898224c4d8bddcec /exec failed with exit code 1
pull / test-models-linux-basic (mv3, portable, cmake, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
RuntimeError: Command docker exec -t 5c86e9ee1eafc1057cfebe73da92e95ad3a434ed07fe082876f82b0e41630e55 /exec failed with exit code 1
pull / test-models-linux-basic (mv3, portable, cmake, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11... / linux-job (gh)
RuntimeError: Command docker exec -t 8d847437074bf1f369cb448421c6cb250eefc0832f62755fb14089f7cfdad527 /exec failed with exit code 1
pull / test-models-linux-basic (mv3, xnnpack-quantization-delegation, buck2, linux.2xlarge, executorch-u... / linux-job (gh)
RuntimeError: Command docker exec -t d51595b3dbce3799353cb0bb686d6bd06246356d46145d0fd37d4e80065291f9 /exec failed with exit code 1
pull / test-models-linux-basic (mv3, xnnpack-quantization-delegation, cmake, linux.2xlarge, executorch-u... / linux-job (gh)
RuntimeError: Command docker exec -t 5327a01fec313dd15631b6eb66fa0539a37df34c3124cc6182f59eed3067f598 /exec failed with exit code 1
pull / test-models-linux-basic (mv3, xnnpack-quantization-delegation, cmake, linux.arm64.2xlarge, execut... / linux-job (gh)
RuntimeError: Command docker exec -t 2e9d95e05c448bb9a3746a61a8c352557b5d4272579fdd19afaa186abeddf46a /exec failed with exit code 1
pull / test-models-linux-basic (vit, portable, buck2, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
RuntimeError: Command docker exec -t d431ba7926204c010580f0d2930f16a598562c3b522e37c25bc2419ba4e7ac8a /exec failed with exit code 1
pull / test-models-linux-basic (vit, portable, cmake, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
RuntimeError: Command docker exec -t 3dd86f77aeca9774160577d817814beb7aa992c963a47823c8777b63a7963ffb /exec failed with exit code 1
pull / test-models-linux-basic (vit, portable, cmake, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11... / linux-job (gh)
RuntimeError: Command docker exec -t 25391880ed258243ec9b0311808683ccf44c8a70eb5de44a5ab47f2bf5f2f332 /exec failed with exit code 1
pull / test-models-linux-basic (vit, xnnpack-quantization-delegation, buck2, linux.2xlarge, executorch-u... / linux-job (gh)
RuntimeError: Command docker exec -t 75d1b30cd7c8eea7eea2e8d6e7bfc78574b882e5e96276cd124f204dc424e84d /exec failed with exit code 1
pull / test-models-linux-basic (vit, xnnpack-quantization-delegation, cmake, linux.2xlarge, executorch-u... / linux-job (gh)
RuntimeError: Command docker exec -t 041b37f33d45840abe311f6f2c64cffe3625b68cbe1a7631b076a5710fc00e4a /exec failed with exit code 1
pull / test-models-linux-basic (vit, xnnpack-quantization-delegation, cmake, linux.arm64.2xlarge, execut... / linux-job (gh)
RuntimeError: Command docker exec -t 69400dd2cb885f9eccf8522b18c77e53a04902d9e47a65c3265a4f5d3ddf720b /exec failed with exit code 1
pull / test-moshi-linux / linux-job (gh)
RuntimeError: Command docker exec -t 658fa6d4fb2a954683d177011151ce06bb7afdca33f04ce72201941e2384bf16 /exec failed with exit code 1
pull / test-multimodal-linux (gemma3-4b) / linux-job (gh)
RuntimeError: Command docker exec -t 34d53222a7cc33a9f6c22c3d0fbec33881eced0247381b273ae023c96eef8cce /exec failed with exit code 1
pull / test-openvino-linux / linux-job (gh)
RuntimeError: Command docker exec -t 0f6da7d29d8b04c200257a441161c342d3e7b0adba51df0e1f73a913051ae46f /exec failed with exit code 1
pull / test-phi-3-mini-runner-linux / linux-job (gh)
RuntimeError: Command docker exec -t 187cc944d391b6d1e812ea74b3f3ebe192bf8c713f97674230d6459a51e8c211 /exec failed with exit code 1
pull / test-qnn-wheel-packages-linux (3.10) / linux-job (gh)
RuntimeError: Command docker exec -t 84261f5df4ade913dcd14d08bfd383ef846bbbc7edc1a6d17db23eb02624114d /exec failed with exit code 1
pull / test-qnn-wheel-packages-linux (3.11) / linux-job (gh)
RuntimeError: Command docker exec -t 1cf6212f702dfe3425696918469cfaedc9fb02e55766427320f0cfd2f844202d /exec failed with exit code 1
pull / test-qnn-wheel-packages-linux (3.12) / linux-job (gh)
RuntimeError: Command docker exec -t 875948be5209b57c9790712b0ef6e45ed4b149103fe02161a1da79f1b69baf64 /exec failed with exit code 1
pull / test-quantized-aot-lib-linux / linux-job (gh)
RuntimeError: Command docker exec -t 06d3a45995138b86d161bf1fa1b39d1382f3229f97f6f7a369ee48271acb1321 /exec failed with exit code 1
pull / test-samsung-models-linux / linux-job (gh)
RuntimeError: Command docker exec -t 26e75e55f372e4ee4cd2df2000ac513204e23fb4bff9f97d705b0eb4a1c1e2d5 /exec failed with exit code 1
pull / test-selective-build-linux / linux-job (gh)
RuntimeError: Command docker exec -t 634479ff18135bb90759489afccd6b1f4079c6765b35dbbe1814b211a5bbc03f /exec failed with exit code 1
pull / test-setup-linux-gcc / linux-job (gh)
RuntimeError: Command docker exec -t 4417f9f4bdcde9f287a00587a371b3a2ab68c1daa46d3bd1962020cc647bae5a /exec failed with exit code 1
pull / test-static-llama-qnn-linux (stories_110m) / linux-job (gh)
RuntimeError: Command docker exec -t 2de6456a3ea01491ac139beedaa7c09bd4d8a8f63ecc48ac69b057bba4e24632 /exec failed with exit code 1
pull / test-static-llama-qnn-linux (stories_260k_bc) / linux-job (gh)
RuntimeError: Command docker exec -t 28ca874c6f5982d84dc9a529554673ce0f59c4e3faeb526006b6688b8b9976e0 /exec failed with exit code 1
pull / test-vulkan-models-linux / linux-job (gh)
RuntimeError: Command docker exec -t 484caa0bd47fa9cf7375bb47fa39c1666939229509da5239465041ad8cb5fa08 /exec failed with exit code 1
pull / test-vulkan-operators-linux / linux-job (gh)
RuntimeError: Command docker exec -t e7ef054c39bb006d6eeab8f88061ba44fa0b741002b4c3e67a631d39b19431ad /exec failed with exit code 1
pull / unittest / linux / linux-job (gh)
RuntimeError: Command docker exec -t b2c1b335fbaf1d41b22b960c372db613a015273f45922e22c59ec8404339ef9c /exec failed with exit code 1
pull / unittest / macos / macos-job (gh)
RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1
pull / unittest / windows / windows-job (gh)
AttributeError: module 'urllib' has no attribute 'URLopener'
pull / unittest-arm-backend-with-no-fvp (test_pytest_models) / linux-job (gh)
RuntimeError: Command docker exec -t 0b4ca226aad6b99df9dc93f25c6cfb0dda16975c4d44a2c9bba4d68e1e66ca45 /exec failed with exit code 1
pull / unittest-arm-backend-with-no-fvp (test_pytest_ops) / linux-job (gh)
RuntimeError: Command docker exec -t 32e805defd863bbbf7dfaa0de4610e60bf0879f801ed0ea2f32c98ed8280a999 /exec failed with exit code 1
pull / unittest-buck / linux / linux-job (gh)
RuntimeError: Command docker exec -t 5da595b73fe07fd6d1904c780af7f74ea0d7cab67c46c08f35be91dd393a3b20 /exec failed with exit code 1
pull / unittest-buck / macos / macos-job (gh)
RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1
pull / unittest-editable / linux / linux-job (gh)
RuntimeError: Command docker exec -t c1038cd5ffdc41e3edae6cdd7bd743903b0c9000f99107728fd7cba2ab809214 /exec failed with exit code 1
pull / unittest-editable / macos / macos-job (gh)
RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1
pull / unittest-nxp-neutron / linux-job (gh)
RuntimeError: Command docker exec -t 02cbe16916abeebb825f0cd255fd3b10ed4bc98adc93aecda04323dfbe450bcb /exec failed with exit code 1
pull / unittest-wasm-bindings (--enable-etdump) / linux-job (gh)
RuntimeError: Command docker exec -t 42856dd02a1a0042854a57588e1128fd03f8b8b9a5684b3080f275ee0bc71db8 /exec failed with exit code 1
pull / unittest-wasm-bindings / linux-job (gh)
RuntimeError: Command docker exec -t e2189c56a2f7defd7aa0ab73f890975e8c185534dfd04322f3981befb64f61a5 /exec failed with exit code 1
Test CUDA Builds / check-all-cuda-builds (gh)
Process completed with exit code 1.
Test CUDA Builds / export-model-cuda-artifact (google, gemma-3-4b-it, non-quantized) / linux-job (gh)
RuntimeError: Command docker exec -t 5939299f14cf872f9cf76909a10fbae4ea4570957c8b01f3c5ab133583ea7673 /exec failed with exit code 1
Test CUDA Builds / export-model-cuda-artifact (google, gemma-3-4b-it, quantized-int4-tile-packed) / linux-job (gh)
RuntimeError: Command docker exec -t e7a571a283b3bdb510d589301eed2214502dd610d6716172207d83a54d0a27bb /exec failed with exit code 1
Test CUDA Builds / export-model-cuda-artifact (mistralai, Voxtral-Mini-3B-2507, non-quantized) / linux-job (gh)
RuntimeError: Command docker exec -t 07db62f94034e996e43e76ff5a1565ec40d73ff5c74dd09ab3581aa1206adfb7 /exec failed with exit code 1
Test CUDA Builds / export-model-cuda-artifact (mistralai, Voxtral-Mini-3B-2507, quantized-int4-tile-packed) / linux-job (gh)
RuntimeError: Command docker exec -t 248b93bda8f024c8760e3506bc50e7f086d9fb2a3d031e2e694f61ef61439c0d /exec failed with exit code 1
Test CUDA Builds / export-model-cuda-artifact (mistralai, Voxtral-Mini-3B-2507, quantized-int4-weight-only) / linux-job (gh)
RuntimeError: Command docker exec -t f32344524ee39f84692b191b845e7e334cc2a429befbda0dccf2a92d2130df5e /exec failed with exit code 1
Test CUDA Builds / export-model-cuda-artifact (openai, whisper-large-v3-turbo, non-quantized) / linux-job (gh)
RuntimeError: Command docker exec -t 0460ad3c07b91db52c6ed0ef6da4c46c44c55e4246f1401dc299db3a7829efb7 /exec failed with exit code 1
Test CUDA Builds / export-model-cuda-artifact (openai, whisper-large-v3-turbo, quantized-int4-tile-packed) / linux-job (gh)
RuntimeError: Command docker exec -t a9b3f68c6f2164124059d0548f7174c75256356d3275f55300ba24572cb65581 /exec failed with exit code 1
Test CUDA Builds / export-model-cuda-artifact (openai, whisper-large-v3-turbo, quantized-int4-weight-only) / linux-job (gh)
RuntimeError: Command docker exec -t 3b9786ef419e9e7196cdc2f7765f8af8556ecbdcb6a03f1880cf2f1c920b639d /exec failed with exit code 1
Test CUDA Builds / export-model-cuda-artifact (openai, whisper-small, non-quantized) / linux-job (gh)
RuntimeError: Command docker exec -t 2ee32b2f80fcbf6350632685adc3c33930e595efbf725b4ec88afb9079396340 /exec failed with exit code 1
Test CUDA Builds / export-model-cuda-artifact (openai, whisper-small, quantized-int4-tile-packed) / linux-job (gh)
RuntimeError: Command docker exec -t 4cc9768e6b0f30ebfeb8773868a3c6affa2841a74e9959e6685150834b7e8a86 /exec failed with exit code 1
Test CUDA Builds / export-model-cuda-artifact (openai, whisper-small, quantized-int4-weight-only) / linux-job (gh)
RuntimeError: Command docker exec -t 07f15b66676a68a5d01efad918116dc22035511fe635322cfec2af32fdd03ed2 /exec failed with exit code 1
Test CUDA Builds / test-executorch-cuda-build-12.6 / linux-job (gh)
RuntimeError: Command docker exec -t 272f2d813e3550ff89db1dbe6ee111182105fcf19eff76c94301cd051be275bf /exec failed with exit code 1
Test CUDA Builds / test-executorch-cuda-build-12.8 / linux-job (gh)
RuntimeError: Command docker exec -t c2f63020672eaf758aa72912098bdc5be786b3c5388392a235d51e9ae9f05892 /exec failed with exit code 1
Test CUDA Builds / test-executorch-cuda-build-13.0 / linux-job (gh)
RuntimeError: Command docker exec -t b734d3ef3a0e176bbc97424ec6ed0bd12b0a5e5ee2ba67262818dbeb34b2d94f /exec failed with exit code 1
Test CUDA Builds / test-models-cuda (add_mul) / linux-job (gh)
RuntimeError: Command docker exec -t 96aea777c8f13cd04b9272af60dee8ac2678ae6c7219e1fad0f7ee5b1535c7b3 /exec failed with exit code 1
Test CUDA Builds / test-models-cuda (add) / linux-job (gh)
RuntimeError: Command docker exec -t 3263da9ccf8f63a36813d52f57dd48ee55e89194bb566fa953d2d7d420cfe1d3 /exec failed with exit code 1
Test CUDA Builds / test-models-cuda (conv1d) / linux-job (gh)
RuntimeError: Command docker exec -t f3124f1cb2c3236995395cfa8c549b18f97c23d6c4e5bb50f78b1efe827d723b /exec failed with exit code 1
Test CUDA Builds / test-models-cuda (linear) / linux-job (gh)
RuntimeError: Command docker exec -t fd1587a97c6d4d56906bf8a41294d6384f4ea805f6d13a4c7edef8c348dde49c /exec failed with exit code 1
Test CUDA Builds / test-models-cuda (resnet18) / linux-job (gh)
RuntimeError: Command docker exec -t 15beace35c789263767e0419b67e459a097eaefba7b29519d98fe83037535a91 /exec failed with exit code 1
Test Metal Backend / export-voxtral-metal-artifact / macos-job (gh)
RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1
Test Metal Backend / test-executorch-metal-build / macos-job (gh)
RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1

This comment was automatically generated by Dr. CI and updates every 15 minutes.

We observed that on iOS it improves perf by 6% because SDPA op does temp allocations. No significant difference on android though. Differential Revision: [D86120038](https://our.internmc.facebook.com/intern/diff/D86120038/) ghstack-source-id: 322321964 Pull Request resolved: #15730

github-actions · 2025-11-11T04:35:25Z

This PR needs a `release notes:` label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

kimishpatel requested review from jackzhxng, kirklandsign, larryliu0820 and mergennachin as code owners November 11, 2025 04:34

This was referenced Nov 10, 2025

[Executorch][llm] Fix flakyness of quantized sdpa test #15653

Merged

[Executorch] parallelize op_choose_qparams #15607

Merged

meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Nov 11, 2025

meta-codesync bot added fb-exported meta-exported labels Nov 11, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[Executorch][LLM] Use caching allocator for runner #15730

[Executorch][LLM] Use caching allocator for runner #15730

kimishpatel commented Nov 11, 2025 •

edited

Loading

Uh oh!

pytorch-bot bot commented Nov 11, 2025 •

edited

Loading

Uh oh!

github-actions bot commented Nov 11, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

[Executorch][LLM] Use caching allocator for runner #15730

Are you sure you want to change the base?

[Executorch][LLM] Use caching allocator for runner #15730

Conversation

kimishpatel commented Nov 11, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pytorch-bot bot commented Nov 11, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/15730

❌ 122 New Failures

Uh oh!

github-actions bot commented Nov 11, 2025

This PR needs a release notes: label

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

kimishpatel commented Nov 11, 2025 •

edited

Loading

pytorch-bot bot commented Nov 11, 2025 •

edited

Loading

This PR needs a `release notes:` label