[Executorch][LLM] Use caching allocator for runner #15656

kimishpatel · 2025-11-06T20:51:33Z

Stack from ghstack (oldest at bottom):

We observed that on iOS it improves perf by 6% because SDPA op does temp allocations.

No significant difference on android though.

Differential Revision: D86120038

We observed that on iOS it improves perf by 6% because SDPA op does temp allocations. No significant difference on android though. Differential Revision: [D86120038](https://our.internmc.facebook.com/intern/diff/D86120038/) [ghstack-poisoned]

pytorch-bot · 2025-11-06T20:51:36Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/15656

📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 116 New Failures, 5 Unrelated Failures

As of commit 66a37e3 with merge base 15a0fcd ():

NEW FAILURES - The following jobs have failed:

Build documentation / build (buck2) / Build doc (gh)
Build Presets / apple (ios-simulator) / build (gh)
RuntimeError: Command bash /Users/runner/work/_temp/exec_script failed with exit code 1
Build Presets / apple (ios) / build (gh)
Build Presets / apple (llm) / build (gh)
RuntimeError: Command bash /Users/runner/work/_temp/exec_script failed with exit code 1
Build Presets / apple (macos) / build (gh)
RuntimeError: Command bash /Users/runner/work/_temp/exec_script failed with exit code 1
Build Presets / apple (pybind) / build (gh)
Build Presets / linux (linux, linux.2xlarge, executorch-ubuntu-22.04-clang12) / build (gh)
RuntimeError: Command docker exec -t 3ac08cab79ea701e034c71d459e840b13c092a7a33bde31a54596de374394970 /exec failed with exit code 1
Build Presets / linux (linux, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11-aarch64) / build (gh)
RuntimeError: Command docker exec -t 711d62eef9aa1b8dc2203711f9dffffd65ad58ac56201d9e4fff114be5d070cf /exec failed with exit code 1
Build Presets / linux (llm, linux.2xlarge, executorch-ubuntu-22.04-clang12) / build (gh)
Build Presets / linux (llm, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11-aarch64) / build (gh)
RuntimeError: Command docker exec -t 293f5300c0e85a93257b328311ca28fc944b63a72e3eb253823deedcf1f5abe4 /exec failed with exit code 1
Build Presets / linux (pybind, linux.2xlarge, executorch-ubuntu-22.04-clang12) / build (gh)
RuntimeError: Command docker exec -t efa7d8a0ec7c2008e654a0f6a41443f526ff78907780025f265c1331f3c18a54 /exec failed with exit code 1
Build Presets / linux (pybind, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11-aarch64) / build (gh)
Lint / lintrunner / linux-job (gh)
>>> Lint for CMakeLists.txt:
periodic / test-models-linux (buck2, mv3, portable, linux.2xlarge, 90) / linux-job (gh)
RuntimeError: Command docker exec -t 9001d6778d17e2757dee0212f6206b1feee2126af9517c96063e2004e7a228bf /exec failed with exit code 1
periodic / test-models-linux (buck2, mv3, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
RuntimeError: Command docker exec -t 9be7783c31e8c5ba64b1262e926f727ac2d1d595715fe5209f23391f4c56157e /exec failed with exit code 1
periodic / test-models-linux (cmake, mv3, portable, linux.2xlarge, 90) / linux-job (gh)
RuntimeError: Command docker exec -t 8812dc7d48889478729975f3ec39411d7d2f5c8e4e4531fa74ed00de0d3e89f4 /exec failed with exit code 1
periodic / test-models-linux (cmake, mv3, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
RuntimeError: Command docker exec -t eb9da5d3a9a4006b2fe51d97a62b01edbfec3f168705a3853a8afdd5d6e7cf37 /exec failed with exit code 1
periodic / test-models-linux (cmake, vit, portable, linux.2xlarge, 90) / linux-job (gh)
RuntimeError: Command docker exec -t 1845a260a620fcf8f24fa175d442eca587fa62573ac81f3094a7104822fc56dd /exec failed with exit code 1
periodic / test-models-linux (cmake, vit, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
RuntimeError: Command docker exec -t 2d477ff688550e95276e137f66de620dd968e715a041b5bdec0d6f17bdd30ed3 /exec failed with exit code 1
pull / android / build-llm-demo / linux-job (gh)
RuntimeError: Command docker exec -t 42a590c8a4e402b908a3d12c4b62637c91c41a75b7755cf33f45b35c96a2e310 /exec failed with exit code 1
pull / test-build-wasm-linux / linux-job (gh)
RuntimeError: Command docker exec -t ecfeb1b1d064e1325b63c84a9674882dabe6ba4e2c8aec34ed08cbb375e56885 /exec failed with exit code 1
pull / test-custom-ops-linux / linux-job (gh)
RuntimeError: Command docker exec -t 60f74371d9a0743cfd25e7d8b5f2a5c8d53d7af15e258b29f2b6d7d20cc7c947 /exec failed with exit code 1
pull / test-eval_llama-wikitext-linux / linux-job (gh)
RuntimeError: Command docker exec -t 9e3c4c271ab94e2dbeff02e5b3997053f42251f3c066668530000a5e8556c0a3 /exec failed with exit code 1
pull / test-llama_runner_eager-linux / linux-job (gh)
RuntimeError: Command docker exec -t c036d5fe0466b6d3184f676c96aeb02365f15031df9d336b4d88cdf93f4e3fef /exec failed with exit code 1
pull / test-llama-lora-linux / linux-job (gh)
RuntimeError: Command docker exec -t e9f42a4297dd2b68e4fe34cacce105920fbd33319da8695cb46ba8d6f8f9f6c6 /exec failed with exit code 1
pull / test-llama-runner-linux (bf16, custom, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
RuntimeError: Command docker exec -t ed85140707fb2adcfb45e8f2443c39535cd2a462260b1cb100374bee7d1d6fb1 /exec failed with exit code 1
pull / test-llama-runner-linux (fp32, xnnpack+custom+qe, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
RuntimeError: Command docker exec -t 30debdf5648a27969a3d9de4d85b5d41d6f68736e65c9591b4e301db06770bd3 /exec failed with exit code 1
pull / test-llama-runner-linux (fp32, xnnpack+custom+qe, linux.arm64.2xlarge, executorch-ubuntu-22.04-gc... / linux-job (gh)
RuntimeError: Command docker exec -t b1f8eda9f39e52d6680b9cf7a41f629201574ce77cbcd66b982be56d3c437bcb /exec failed with exit code 1
pull / test-llama-runner-linux (fp32, xnnpack+custom+quantize_kv, linux.2xlarge, executorch-ubuntu-22.04... / linux-job (gh)
RuntimeError: Command docker exec -t 50bcd6493fc957128a40590c59156da494fa0dac8578ddc5e8f01377ee7aa2f9 /exec failed with exit code 1
pull / test-llama-runner-linux (fp32, xnnpack+custom+quantize_kv, linux.arm64.2xlarge, executorch-ubuntu... / linux-job (gh)
RuntimeError: Command docker exec -t 9c9c2c10c159ad9290e8196b54b8474dbf4b99ee63572aef4fdacda699257827 /exec failed with exit code 1
pull / test-llama-runner-linux (fp32, xnnpack+quantize_kv, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
RuntimeError: Command docker exec -t d1da3318927814f08de8daf379cc108889eca03946caab0951471ed02444ba45 /exec failed with exit code 1
pull / test-llama-runner-linux (fp32, xnnpack+quantize_kv, linux.arm64.2xlarge, executorch-ubuntu-22.04-... / linux-job (gh)
RuntimeError: Command docker exec -t 920aca869f70e0ecad5d11d361d7711d6ad353d2c9a356fca4ddecf6a337ce38 /exec failed with exit code 1
pull / test-llama-runner-linux-android / linux-job (gh)
RuntimeError: Command docker exec -t 06fe23aec2d675fea7d01cd549cee985c467e5ff597240c2e098925a7591cad8 /exec failed with exit code 1
pull / test-llama-runner-qnn-linux (fp32, qnn_16a16w, qnn) / linux-job (gh)
RuntimeError: Command docker exec -t d4d41eefb11ac3e8d0410cc22abf7f659dc0caecf3c8e34e48f09f0800d58148 /exec failed with exit code 1
pull / test-llama-runner-qnn-linux (fp32, qnn_8a8w, qnn) / linux-job (gh)
RuntimeError: Command docker exec -t d84e06c189347cdabc86af4a001e3b253d39a7f68fa56c85f22fdb6bf3f741b0 /exec failed with exit code 1
pull / test-mediatek-models-linux / linux-job (gh)
RuntimeError: Command docker exec -t 37b5e19dc926cbbf5c0334839095bbb4b99648fdabfd716a03f2c59ad4170e5e /exec failed with exit code 1
pull / test-models-linux (add_mul, portable, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t d975faf916d927f004fdf575432ce09a062164e5b8954be74019e89ad44d0a0c /exec failed with exit code 1
pull / test-models-linux (add_mul, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t 276ca19903310f2b1632b895fbf6d2222c55076367cefd042ba8e9c7aa06dc5c /exec failed with exit code 1
pull / test-models-linux (add, portable, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t e8021faf39ca8be0e58e5b0c09788fbe53be52a9df767873612af0f1b19b4a1f /exec failed with exit code 1
pull / test-models-linux (add, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t 92d0f795a6e7f868dde35da2c8487c1cc6c331d05db74487bb1888261874cf1f /exec failed with exit code 1
pull / test-models-linux (emformer_join, portable, linux.4xlarge.memory) / linux-job (gh)
RuntimeError: Command docker exec -t 3c313db752f95262a31e05b113e47e423613d42256f92e765744419c24214e62 /exec failed with exit code 1
pull / test-models-linux (emformer_join, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
RuntimeError: Command docker exec -t d8927ab5a2aa03643827661bbf4c543736c7e0dcae72b7d745738a985b07ffbe /exec failed with exit code 1
pull / test-models-linux (emformer_transcribe, portable, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t e47216c2576b78446e0139ce8eb67a5724dc0046a698a1d75c822c6d326a47d4 /exec failed with exit code 1
pull / test-models-linux (emformer_transcribe, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t a47bcb680bcad16d0b8736b5d715c72872fecf7cd528d61e65f0441edee76382 /exec failed with exit code 1
pull / test-models-linux (ic3, portable, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t 2c7e7723cb415555165b139547f33c5f17aff1eceeb03fa21e8fedb10a0de345 /exec failed with exit code 1
pull / test-models-linux (ic3, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t c0760c5c076358d76d085f0db3017686c11ff187153b2628526b562b7268f05a /exec failed with exit code 1
pull / test-models-linux (ic4, portable, linux.4xlarge.memory) / linux-job (gh)
RuntimeError: Command docker exec -t 4385942c870ab0b8426224b7f775be6ccbb3cd35a475d485519b9ea1477d9879 /exec failed with exit code 1
pull / test-models-linux (ic4, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
RuntimeError: Command docker exec -t 2046b29c62d6d7a48440cefac02d371ac70216b59d36a38c1a4ef638ea3ce23a /exec failed with exit code 1
pull / test-models-linux (linear, portable, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t ececab17a985000a391f11721af2875ccf20eddc23255b8944092147cd6756ab /exec failed with exit code 1
pull / test-models-linux (linear, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t 0f65043090cfa79fb5334ac061be34dadee25737bd6ab1e90f65d39a77014005 /exec failed with exit code 1
pull / test-models-linux (llama3_2_vision_encoder, portable, linux.4xlarge.memory) / linux-job (gh)
RuntimeError: Command docker exec -t 72200d0402a373f7f1392e24a45be2ae58b0211adb648189f94138da70c315d3 /exec failed with exit code 1
pull / test-models-linux (mobilebert, portable, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t ae87b27866fbe4d1f23488b522c1d987417ab4b199a10acda7036b1595d5ceb0 /exec failed with exit code 1
pull / test-models-linux (mobilebert, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t 23bcffcac8b336cb2476ca7cc21aa8c898398d147db5e9641ec8f6d6ccad76dd /exec failed with exit code 1
pull / test-models-linux (mv2, portable, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t fbd0f53b15d3feaf52fa1a4d7380676c939e0cbbc67c41bbe0338f3cc324be74 /exec failed with exit code 1
pull / test-models-linux (mv2, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t ed81ab178efd52214d567ad30b440efc4686b4b0dde68b87cc9a2713b4ecf246 /exec failed with exit code 1
pull / test-models-linux (phi_4_mini, portable, linux.4xlarge.memory) / linux-job (gh)
RuntimeError: Command docker exec -t 7288263e946ef2c8a3209c2734a1f2f77f5ac591c4ea388067330adc97c11d31 /exec failed with exit code 1
pull / test-models-linux (resnet18, portable, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t e90d4820bfa003fa6ce8b35413e787dab92c31d8b7f352572a5c8e055cb7d1ab /exec failed with exit code 1
pull / test-models-linux (resnet18, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t db8ed8b3d3c9ea88564a09f536fcc3334f88c745892a0fac0c51efbd3b11dcfd /exec failed with exit code 1
pull / test-models-linux (resnet50, portable, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t 5d0ebb7b3c843e06b066fa6a87111c9100690a6689b06416d28625cca81f3a11 /exec failed with exit code 1
pull / test-models-linux (resnet50, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
RuntimeError: Command docker exec -t 1c13b1cdf8f80aaf040c7ea38ee990ed40635551ed86d0e8aae0b8308e0b714a /exec failed with exit code 1
pull / test-models-linux (w2l, portable, linux.4xlarge.memory) / linux-job (gh)
RuntimeError: Command docker exec -t e2acc48113f92e39d521db5554d9d337fcb97dd433a79d2f4289743a16d5fbb5 /exec failed with exit code 1
pull / test-models-linux-basic (mv3, portable, buck2, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
RuntimeError: Command docker exec -t 690ca0dbfa9908b40cd67a63b916816528d86f9837bbffc69b6639ce63a30bda /exec failed with exit code 1
pull / test-models-linux-basic (mv3, portable, cmake, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
RuntimeError: Command docker exec -t 37d1240e4ed114dd2fa37d1dfe08ec1fd320f3c021330ce98458cb2158cb4c56 /exec failed with exit code 1
pull / test-models-linux-basic (mv3, portable, cmake, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11... / linux-job (gh)
RuntimeError: Command docker exec -t b62f713a38a90c1cb8a7a1fd4521692fe1ca09bf81f15d4e66bfa7ee88708047 /exec failed with exit code 1
pull / test-models-linux-basic (mv3, xnnpack-quantization-delegation, buck2, linux.2xlarge, executorch-u... / linux-job (gh)
RuntimeError: Command docker exec -t 604f29de00ab4e0ab2a654d8b8ba5db2a9e3d3a95d727500a478d8222b81a7e9 /exec failed with exit code 1
pull / test-models-linux-basic (mv3, xnnpack-quantization-delegation, cmake, linux.2xlarge, executorch-u... / linux-job (gh)
RuntimeError: Command docker exec -t 43d8535e2283fbec00b0fb5cb34e20b104e56e9b055c521972be79afc8119c65 /exec failed with exit code 1
pull / test-models-linux-basic (mv3, xnnpack-quantization-delegation, cmake, linux.arm64.2xlarge, execut... / linux-job (gh)
RuntimeError: Command docker exec -t 2767b6f2fdd8a4e98a86c554406ab4c12ef5035de8fe083a965982b419988bb3 /exec failed with exit code 1
pull / test-models-linux-basic (vit, portable, buck2, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
RuntimeError: Command docker exec -t f3740fdb477a2ef4bc18efbb03db765099d2a252bdd9df0ac935eda018630fc0 /exec failed with exit code 1
pull / test-models-linux-basic (vit, portable, cmake, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
RuntimeError: Command docker exec -t 0f8fa5e3eadc61761bd37eb138534e9b115e71e94f3ac09ee7077395039caa64 /exec failed with exit code 1
pull / test-models-linux-basic (vit, portable, cmake, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11... / linux-job (gh)
RuntimeError: Command docker exec -t ad27aed4d3250716a2a218fb8dd4fa4294eede253d4ce7a945463268cc9e90ee /exec failed with exit code 1
pull / test-models-linux-basic (vit, xnnpack-quantization-delegation, buck2, linux.2xlarge, executorch-u... / linux-job (gh)
RuntimeError: Command docker exec -t 4da0f41a1c7e7b21a4bac22d3b9e8b88ca6235c3a78913e624f96d15bd2400e6 /exec failed with exit code 1
pull / test-models-linux-basic (vit, xnnpack-quantization-delegation, cmake, linux.2xlarge, executorch-u... / linux-job (gh)
RuntimeError: Command docker exec -t 42204b883e6614dd9e48a8d7f017fb211a91c92ee8cb2dd763a54ec99997e349 /exec failed with exit code 1
pull / test-models-linux-basic (vit, xnnpack-quantization-delegation, cmake, linux.arm64.2xlarge, execut... / linux-job (gh)
RuntimeError: Command docker exec -t b662b61bc1fe3046b1a932583f8ef921fe4ff058d7e8759b7fa5990d267e3087 /exec failed with exit code 1
pull / test-moshi-linux / linux-job (gh)
RuntimeError: Command docker exec -t 3fce6bb38dd0261212509b0c228b04dbd9fe5d349e2bfd895ec3342eb7e0fe55 /exec failed with exit code 1
pull / test-multimodal-linux (gemma3-4b) / linux-job (gh)
RuntimeError: Command docker exec -t 4d19476f2c80606e49c28cbca3275af7fe0b0a643434e7c4babc23d29eafc0c1 /exec failed with exit code 1
pull / test-phi-3-mini-runner-linux / linux-job (gh)
RuntimeError: Command docker exec -t bdda5a4a824686a8b804465d2597388627cb4c4e7b3b433799d33a041fa39c9e /exec failed with exit code 1
pull / test-qnn-wheel-packages-linux (3.10) / linux-job (gh)
RuntimeError: Command docker exec -t 7b6a6e667179aebcfc8f24dfc436844a8ff556e0676822e8ab4ed5eac94fc09c /exec failed with exit code 1
pull / test-qnn-wheel-packages-linux (3.11) / linux-job (gh)
RuntimeError: Command docker exec -t ac06741403d81f03d210b83d4038da16fd9f93780181596ca3152358835edd99 /exec failed with exit code 1
pull / test-qnn-wheel-packages-linux (3.12) / linux-job (gh)
RuntimeError: Command docker exec -t 29f3a4ce2c88eddcafb710a2ad75a2c97b3f54a0ad1d0ac768f9dbbe13f1eede /exec failed with exit code 1
pull / test-quantized-aot-lib-linux / linux-job (gh)
RuntimeError: Command docker exec -t f06eed92a35d03e9ffeb29639172e999aa79a8a3570d734fac66e1367fe6e90c /exec failed with exit code 1
pull / test-samsung-models-linux / linux-job (gh)
RuntimeError: Command docker exec -t 9bb02105b1dda27ce1df8389e9a432f87fda723f842e04ef8a6227c9ab1c1fc0 /exec failed with exit code 1
pull / test-selective-build-linux / linux-job (gh)
RuntimeError: Command docker exec -t b08a4d23bd923e27e5e8224604cc58e9e52a9b5f4560892491c3beb7971366ee /exec failed with exit code 1
pull / test-static-llama-qnn-linux (stories_110m) / linux-job (gh)
RuntimeError: Command docker exec -t fc2a0a5a179d9b9a9f5137ea43178d60cd5e113d407b63caef93a6bac60fcaeb /exec failed with exit code 1
pull / test-static-llama-qnn-linux (stories_260k_bc) / linux-job (gh)
RuntimeError: Command docker exec -t 05353f1b7463004caf61c5737b09b655230fac3ae66d0907007c13d2b3cecd62 /exec failed with exit code 1
pull / test-vulkan-models-linux / linux-job (gh)
RuntimeError: Command docker exec -t 91428cdbdd865262dd180ed6d638299604f6c9a4d430916ff0c1ca10b23b5e00 /exec failed with exit code 1
pull / test-vulkan-operators-linux / linux-job (gh)
RuntimeError: Command docker exec -t b51ab3f451d46cf2cc726776615aa051ae77cd8b39cdefd926e9b415772b38a3 /exec failed with exit code 1
pull / unittest / linux / linux-job (gh)
RuntimeError: Command docker exec -t 25a05dbe591a7149b8d5b4d7ee94873d62b264d050629f254272a453426d3856 /exec failed with exit code 1
pull / unittest / macos / macos-job (gh)
RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1
pull / unittest-arm-backend-with-no-fvp (test_pytest_models) / linux-job (gh)
RuntimeError: Command docker exec -t a1f25f3b7ffbcaae4849e0b35d5182d6e2f4975d43c9fd19b3de0b2ef27191ad /exec failed with exit code 1
pull / unittest-arm-backend-with-no-fvp (test_pytest_ops) / linux-job (gh)
RuntimeError: Command docker exec -t 831e45fa4d4c2bfbb5c7cddc7239ca863049b04699ceadf6fcd9be6139361932 /exec failed with exit code 1
pull / unittest-buck / linux / linux-job (gh)
RuntimeError: Command docker exec -t 797ba84f6306e2295762680b33e49effdbecd86ea4f1d391f861f1f35eab6a92 /exec failed with exit code 1
pull / unittest-buck / macos / macos-job (gh)
RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1
pull / unittest-editable / linux / linux-job (gh)
RuntimeError: Command docker exec -t 750ca0ae43f6941e6cd43674957dee9afe9d5e41c92a02df83dc1404fbeeaab7 /exec failed with exit code 1
pull / unittest-editable / macos / macos-job (gh)
RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1
pull / unittest-nxp-neutron / linux-job (gh)
RuntimeError: Command docker exec -t 0be8dfd333177672641d66d2c4d36707cace204fbbc52aaffab015c3b1e56fa0 /exec failed with exit code 1
pull / unittest-wasm-bindings (--enable-etdump) / linux-job (gh)
RuntimeError: Command docker exec -t 7012ac55f2ca94204d1145ecaa0d7199080b4a3b4f9c0a958ba9492f91ab4b2c /exec failed with exit code 1
pull / unittest-wasm-bindings / linux-job (gh)
RuntimeError: Command docker exec -t e3508cb7339349608c1cbab729653cbfa47ab23bc6d6485d935f834b93de4353 /exec failed with exit code 1
Test CUDA Builds / check-all-cuda-builds (gh)
Process completed with exit code 1.
Test CUDA Builds / export-model-cuda-artifact (google, gemma-3-4b-it, non-quantized) / linux-job (gh)
RuntimeError: Command docker exec -t 084a804724246d08ca2704dc20275ea84e85e6553375970402e855484780251c /exec failed with exit code 1
Test CUDA Builds / export-model-cuda-artifact (google, gemma-3-4b-it, quantized-int4-tile-packed) / linux-job (gh)
RuntimeError: Command docker exec -t 53403b568c06e2aaf84861dde2016118a11d88ab1cdfd8a3ff886287dfd7f16c /exec failed with exit code 1
Test CUDA Builds / export-model-cuda-artifact (mistralai, Voxtral-Mini-3B-2507, non-quantized) / linux-job (gh)
RuntimeError: Command docker exec -t 82083633349b609f919626c7b02322fc5545b700389f28faa74d095dc220ef04 /exec failed with exit code 1
Test CUDA Builds / export-model-cuda-artifact (mistralai, Voxtral-Mini-3B-2507, quantized-int4-tile-packed) / linux-job (gh)
RuntimeError: Command docker exec -t 28ebd490ef67295f78762cc143e2360104de75de0805da616964c3e65d53144e /exec failed with exit code 1
Test CUDA Builds / export-model-cuda-artifact (mistralai, Voxtral-Mini-3B-2507, quantized-int4-weight-only) / linux-job (gh)
RuntimeError: Command docker exec -t 6e84eb3c5ac830a7005d82b88f1bbb1903c74b5e212f215311cd06c358e177d0 /exec failed with exit code 1
Test CUDA Builds / export-model-cuda-artifact (openai, whisper-small, non-quantized) / linux-job (gh)
RuntimeError: Command docker exec -t 97a8f8b819e362ed92d4ceea9a729795bafb6d887d6ebc0c7f807bfe8ec94064 /exec failed with exit code 1
Test CUDA Builds / export-model-cuda-artifact (openai, whisper-small, quantized-int4-tile-packed) / linux-job (gh)
RuntimeError: Command docker exec -t 031bc9d75106377c00a4cda716b350a5ef2449c62487ed01811730299d2d42c6 /exec failed with exit code 1
Test CUDA Builds / export-model-cuda-artifact (openai, whisper-small, quantized-int4-weight-only) / linux-job (gh)
RuntimeError: Command docker exec -t 37eb401c8c3bc816cd3e169dd3660e7d76da592381a8226a1d0eeb252998f92a /exec failed with exit code 1
Test CUDA Builds / test-executorch-cuda-build-12.6 / linux-job (gh)
RuntimeError: Command docker exec -t 32ed226ba2c1063bbdd590b182d91dee1422eb3f8670f04859e949eaa667fbc5 /exec failed with exit code 1
Test CUDA Builds / test-executorch-cuda-build-12.8 / linux-job (gh)
RuntimeError: Command docker exec -t da60d69feb006c78989973ec6599c2415617271dfbc1396ff599767f5ee2b4b7 /exec failed with exit code 1
Test CUDA Builds / test-executorch-cuda-build-13.0 / linux-job (gh)
RuntimeError: Command docker exec -t 39c8808ef7ae1cb8e09acba1f30e18f401388f1e38707c13a99427d739ae6ca6 /exec failed with exit code 1
Test CUDA Builds / test-models-cuda (add_mul) / linux-job (gh)
RuntimeError: Command docker exec -t 706d767ef470045da2d9b050ae0d220314308819a4c5a8dbb68becd827648dce /exec failed with exit code 1
Test CUDA Builds / test-models-cuda (add) / linux-job (gh)
RuntimeError: Command docker exec -t 3a28f12423ece737e05a68d3a96d565749999efac8eb084594446cfd44f1b57c /exec failed with exit code 1
Test CUDA Builds / test-models-cuda (conv1d) / linux-job (gh)
RuntimeError: Command docker exec -t 14c8509067d913116e7b6f6c15c4df10a0504d0b43ea301943196252838f2b14 /exec failed with exit code 1
Test CUDA Builds / test-models-cuda (linear) / linux-job (gh)
RuntimeError: Command docker exec -t eca62caeec22c89e6a830d077c6557647409404488c1d83d563fe988612ee47f /exec failed with exit code 1
Test CUDA Builds / test-models-cuda (resnet18) / linux-job (gh)
RuntimeError: Command docker exec -t b88107418c4da8385c571e7049171479dc13acf44004268d18877ac0323e0050 /exec failed with exit code 1
Test Metal Backend / export-voxtral-metal-artifact / macos-job (gh)
RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1
Test Metal Backend / test-executorch-metal-build / macos-job (gh)
RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

pull / test-binary-size-linux-gcc / linux-job (gh) (trunk failure)
##[error]The operation was canceled.
pull / test-openvino-linux / linux-job (gh) (trunk failure)
##[error]The operation was canceled.
pull / test-setup-linux-gcc / linux-job (gh) (trunk failure)
##[error]The operation was canceled.
pull / unittest / windows / windows-job (gh) (trunk failure)
backends/xnnpack/test/ops/test_conv1d.py::TestConv1d::test_qs8_conv1d_batchnorm_seq
pull / unittest-editable / windows / windows-job (gh) (trunk failure)
backends/xnnpack/test/ops/test_conv1d.py::TestConv1d::test_qs8_conv1d_batchnorm_seq

This comment was automatically generated by Dr. CI and updates every 15 minutes.

We observed that on iOS it improves perf by 6% because SDPA op does temp allocations. No significant difference on android though. Differential Revision: [D86120038](https://our.internmc.facebook.com/intern/diff/D86120038/) ghstack-source-id: 321483010 Pull Request resolved: #15656

github-actions · 2025-11-06T20:52:08Z

This PR needs a `release notes:` label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

kimishpatel requested review from jackzhxng, kirklandsign, larryliu0820 and mergennachin as code owners November 6, 2025 20:51

meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Nov 6, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[Executorch][LLM] Use caching allocator for runner #15656

[Executorch][LLM] Use caching allocator for runner #15656

kimishpatel commented Nov 6, 2025 •

edited

Loading

Uh oh!

pytorch-bot bot commented Nov 6, 2025 •

edited

Loading

Uh oh!

github-actions bot commented Nov 6, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

[Executorch][LLM] Use caching allocator for runner #15656

Are you sure you want to change the base?

[Executorch][LLM] Use caching allocator for runner #15656

Conversation

kimishpatel commented Nov 6, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pytorch-bot bot commented Nov 6, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/15656

❌ 116 New Failures, 5 Unrelated Failures

Uh oh!

github-actions bot commented Nov 6, 2025

This PR needs a release notes: label

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

kimishpatel commented Nov 6, 2025 •

edited

Loading

pytorch-bot bot commented Nov 6, 2025 •

edited

Loading

This PR needs a `release notes:` label