Failed to build installable wheels for some pyproject.toml based projects (executorch)

[ManojShanmugamTruminds]

I have followed https://github.com/pytorch/executorch/blob/main/examples/demo-apps/apple_ios/LLaMA/docs/delegates/mps_README.md link to config executorch but getting error after passing below command in my MacBook Pro.
OS version 15.3.1
Apple M1 chip
Command :
./install_executorch.sh

Error while generating /Users/manojshanmugam/executorch/pip-out/temp.macosx-11.1-arm64-cpython-310/cmake-out/executorch_srcs.cmake. Exit code: 1
Output:

Error:
Traceback (most recent call last):
File "/Users/manojshanmugam/executorch/build/extract_sources.py", line 255, in
main()
File "/Users/manojshanmugam/executorch/build/extract_sources.py", line 240, in main
target_to_srcs[name] = sorted(target.get_sources(graph, runner, buck_args))
File "/Users/manojshanmugam/executorch/build/extract_sources.py", line 132, in get_sources
sources: set[str] = set(runner.run(["cquery", query] + buck_args))
File "/Users/manojshanmugam/executorch/build/buck_util.py", line 26, in run
cp: subprocess.CompletedProcess = subprocess.run(
File "/opt/anaconda3/envs/et_xnnpack/lib/python3.10/subprocess.py", line 501, in run
with Popen(*popenargs, **kwargs) as process:
File "/opt/anaconda3/envs/et_xnnpack/lib/python3.10/subprocess.py", line 966, in init
self._execute_child(args, executable, preexec_fn, close_fds,
File "/opt/anaconda3/envs/et_xnnpack/lib/python3.10/subprocess.py", line 1842, in _execute_child
raise child_exception_type(errno_num, err_msg, err_filename)
FileNotFoundError: [Errno 2] No such file or directory: 'buck2'

CMake Error at build/Utils.cmake:236 (message):
executorch: source list generation failed
Call Stack (most recent call first):
CMakeLists.txt:403 (extract_sources)

error: subprocess-exited-with-error

× Building wheel for executorch (pyproject.toml) did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.
full command: /opt/anaconda3/envs/et_xnnpack/bin/python /opt/anaconda3/envs/et_xnnpack/lib/python3.10/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py build_wheel /var/folders/ys/j_jmfr7n1nlbsc4zl1tqhxmw0000gn/T/tmp6g9kb72l
cwd: /Users/manojshanmugam/executorch
Building wheel for executorch (pyproject.toml) ... error
ERROR: Failed building wheel for executorch
Failed to build executorch
ERROR: Failed to build installable wheels for some pyproject.toml based projects (executorch)
Traceback (most recent call last):
File "/Users/manojshanmugam/executorch/./install_executorch.py", line 245, in
main(sys.argv[1:])
File "/Users/manojshanmugam/executorch/./install_executorch.py", line 223, in main
subprocess.run(
File "/opt/anaconda3/envs/et_xnnpack/lib/python3.10/subprocess.py", line 524, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['/opt/anaconda3/envs/et_xnnpack/bin/python', '-m', 'pip', 'install', '.', '--no-build-isolation', '-v', '--extra-index-url', 'https://download.pytorch.org/whl/nightly/cpu']' returned non-zero exit status 1.

cc @mergennachin @byjlw

[guangy10]

@ManojShanmugamTruminds Have you tried clean up first and rebuild from scratch? If not, please try this:

# From the root of the executorch repo:
./install_executorch.sh --clean
git submodule sync
git submodule update --init

Then rerun ./install_executorch.sh

Can you also check if you macbook has access to the network? I noticed this error:

FileNotFoundError: [Errno 2] No such file or directory: 'buck2'

Users shouldn't be aware of the buck2 and the download should be handled properly. cc: @GregoryComer who has been implementing the script to handle buck downloading.

If you still hit the same issue, to help us better understand your setup, you can attach you dev env by running the following commands:

wget https://raw.githubusercontent.com/pytorch/pytorch/main/torch/utils/collect_env.py
# For security purposes, please check the contents of collect_env.py before running it.
python collect_env.py

[ManojShanmugamTruminds]

Still getting same error after following ./install_executorch.sh --clean command

Getting No such file or directory error if i am running python collect_env.py command

(et_mps) manojshanmugam@MacBookPro executorch % python collect_env.py
python3: can't open file '/Users/manojshanmugam/executorch/collect_env.py': [Errno 2] No such file or directory

[guangy10]

Still getting same error after following ./install_executorch.sh --clean command

Thanks for the confirmation

Getting No such file or directory error if i am running python collect_env.py command

(et_mps) manojshanmugam@MacBookPro executorch % python collect_env.py python3: can't open file '/Users/manojshanmugam/executorch/collect_env.py': [Errno 2] No such file or directory

You need to download the collect_env.py first. wget https://raw.githubusercontent.com/pytorch/pytorch/main/torch/utils/collect_env.py

[ManojShanmugamTruminds]

Got below details , Also attached data of base terminal
(et_mps) manojshanmugam@MacBookPro executorch % python collect_env.py
Collecting environment information...
PyTorch version: 2.7.0.dev20250131
Is debug build: False
CUDA used to build PyTorch: None
ROCM used to build PyTorch: N/A

OS: macOS 15.3.1 (arm64)
GCC version: Could not collect
Clang version: 16.0.0 (clang-1600.0.26.6)
CMake version: version 3.31.4
Libc version: N/A

Python version: 3.10.0 (default, Mar 3 2022, 03:54:28) [Clang 12.0.0 ] (64-bit runtime)
Python platform: macOS-15.3.1-arm64-i386-64bit
Is CUDA available: False
CUDA runtime version: No CUDA
CUDA_MODULE_LOADING set to: N/A
GPU models and configuration: No CUDA
Nvidia driver version: No CUDA
cuDNN version: No CUDA
HIP runtime version: N/A
MIOpen runtime version: N/A
Is XNNPACK available: True

CPU:
Apple M1

Versions of relevant libraries:
[pip3] numpy==2.2.3
[pip3] torch==2.7.0.dev20250131
[pip3] torchao==0.8.0+git11333ba2
[pip3] torchaudio==2.6.0.dev20250131
[pip3] torchsr==1.0.4
[pip3] torchvision==0.22.0.dev20250131
[conda] numpy 2.2.3 pypi_0 pypi
[conda] torch 2.7.0.dev20250131 pypi_0 pypi
[conda] torchao 0.8.0+git11333ba2 pypi_0 pypi
[conda] torchaudio 2.6.0.dev20250131 pypi_0 pypi
[conda] torchsr 1.0.4 pypi_0 pypi
[conda] torchvision 0.22.0.dev20250131 pypi_0 pypi
(et_mps) manojshanmugam@MacBookPro executorch %

Terminal with base :

(base) manojshanmugam@MacBookPro ~ % python collect_env.py
Collecting environment information...
PyTorch version: 2.7.0.dev20250224
Is debug build: False
CUDA used to build PyTorch: None
ROCM used to build PyTorch: N/A

OS: macOS 15.3.1 (arm64)
GCC version: Could not collect
Clang version: 16.0.0 (clang-1600.0.26.6)
CMake version: version 3.31.2
Libc version: N/A

Python version: 3.12.7 | packaged by Anaconda, Inc. | (main, Oct 4 2024, 08:22:19) [Clang 14.0.6 ] (64-bit runtime)
Python platform: macOS-15.3.1-arm64-i386-64bit
Is CUDA available: False
CUDA runtime version: No CUDA
CUDA_MODULE_LOADING set to: N/A
GPU models and configuration: No CUDA
Nvidia driver version: No CUDA
cuDNN version: No CUDA
HIP runtime version: N/A
MIOpen runtime version: N/A
Is XNNPACK available: True

CPU:
Apple M1

Versions of relevant libraries:
[pip3] flake8==7.0.0
[pip3] mypy==1.11.2
[pip3] mypy-extensions==1.0.0
[pip3] numpy==1.26.4
[pip3] numpydoc==1.7.0
[pip3] torch==2.7.0.dev20250224
[pip3] torchao==0.8.0+git11333ba2
[pip3] torchaudio==2.6.0.dev20250131
[pip3] torchsr==1.0.4
[pip3] torchvision==0.22.0.dev20250131
[conda] numpy 1.26.4 py312h7f4fdc5_0
[conda] numpy-base 1.26.4 py312he047099_0
[conda] numpydoc 1.7.0 py312hca03da5_0
[conda] torch 2.7.0.dev20250224 pypi_0 pypi
[conda] torchao 0.8.0+git11333ba2 pypi_0 pypi
[conda] torchaudio 2.6.0.dev20250131 pypi_0 pypi
[conda] torchsr 1.0.4 pypi_0 pypi
[conda] torchvision 0.22.0.dev20250131 pypi_0 pypi
(base) manojshanmugam@MacBookPro ~ %

[guangy10]

@ManojShanmugamTruminds Do you still see this error?

FileNotFoundError: [Errno 2] No such file or directory: 'buck2'

If you can wget the script, I think you access to network just works fine, but somehow still not able to get the buck2 resolved even after the --clean. Can you confirm?

[ManojShanmugamTruminds]

Still FileNotFoundError: [Errno 2] No such file or directory: 'buck2' error remains I am able to see

[guangy10]

Still FileNotFoundError: [Errno 2] No such file or directory: 'buck2' error remains I am able to see

cc @GregoryComer